Jun 04 13:09:25 devstack cinder-volume[75830]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75830) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 13:09:25 devstack cinder-volume[75830]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75830) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 13:09:25 devstack cinder-volume[75830]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75830) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 13:09:26 devstack cinder-volume[75830]: INFO dbcounter [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Registered counter for database cinder Jun 04 13:09:26 devstack cinder-volume[75830]: DEBUG oslo_db.sqlalchemy.engines [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:09:26 devstack cinder-volume[75830]: DEBUG dbcounter [-] [75830] Writer thread running {{(pid=75830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 13:09:26 devstack cinder-volume[75830]: INFO cinder.rpc [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 04 13:09:26 devstack cinder-volume[75830]: INFO cinder.rpc [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 04 13:09:26 devstack cinder-volume[75830]: DEBUG oslo_db.sqlalchemy.engines [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:09:27 devstack cinder-volume[75830]: INFO cinder.volume.manager [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Determined volume DB was empty at startup. Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG cinder.volume.manager [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75830) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 04 13:09:27 devstack cinder-volume[75830]: INFO cinder.volume.manager [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 04 13:09:27 devstack cinder-volume[75830]: WARNING stevedore.named [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 13:09:27 devstack cinder-volume[75830]: WARNING castellan.key_manager [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 13:09:27 devstack cinder-volume[75830]: WARNING cinder.keymgr.conf_key_mgr [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG cinder.volume.drivers.lvm [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75830) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_concurrency.processutils [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_concurrency.processutils [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.437s {{(pid=75830) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_db.sqlalchemy.engines [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:09:27 devstack cinder-volume[75830]: INFO cinder.rpc [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 04 13:09:27 devstack cinder-volume[75830]: INFO cinder.rpc [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 04 13:09:27 devstack cinder-volume[75830]: WARNING stevedore.named [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 13:09:27 devstack cinder-volume[75830]: WARNING castellan.key_manager [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 13:09:27 devstack cinder-volume[75830]: INFO cinder.volume.manager [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_db.sqlalchemy.engines [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:09:27 devstack cinder-volume[75830]: INFO oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Starting 1 workers Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Started child 76038 {{(pid=75830) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Full set of CONF: {{(pid=75830) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] ******************************************************************************** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Configuration options gathered from: {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] ================================================================================ {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] allow_availability_zone_fallback = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[76038]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] allow_compression_on_image_upload = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] allowed_direct_url_schemes = [] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] api_rate_limit = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] auth_strategy = keystone {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] az_cache_duration = 3600 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_availability_zone = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_host = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_name = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_stats_polling_interval = 60 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backup_api_class = cinder.backup.api.API {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backup_name_template = backup-%s {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backup_use_same_host = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backup_use_temp_snapshot = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] chap_password = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] chap_username = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cinder_internal_tenant_project_id = 069b2c6f5a5849baab57437f63c9d935 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cinder_internal_tenant_user_id = 85d3096e90ae49e7b63698861e277543 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cloned_volume_same_az = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cluster = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] compression_format = gzip {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] compute_api_class = cinder.compute.nova.API {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] config_dir = [] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] config_source = [] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] control_exchange = openstack {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] debug = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] default_availability_zone = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] default_group_type = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] default_volume_type = lvmdriver-1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] disk_geometry = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] driver_client_cert = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] driver_client_cert_key = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] driver_data_namespace = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] driver_ssl_cert_path = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] driver_ssl_cert_verify = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] driver_use_ssl = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] enable_force_upload = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] enable_new_services = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] enable_unsupported_driver = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] enforce_multipath_for_image_xfer = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] filter_function = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance_api_insecure = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance_api_servers = ['http://192.168.122.227/image'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance_api_ssl_compression = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance_ca_certificates_file = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance_catalog_info = image:glance:publicURL {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance_certfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance_keyfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance_num_retries = 3 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance_request_timeout = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] goodness_function = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] graceful_shutdown_timeout = 5 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] group_api_class = cinder.group.api.API {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] host = devstack {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] image_compress_on_upload = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[76038]: INFO cinder.volume.manager [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] image_conversion_address_space_limit = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] image_conversion_cpu_limit = 60 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] image_conversion_disable = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] image_upload_use_cinder_backend = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] image_upload_use_internal_tenant = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] image_volume_cache_enabled = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] image_volume_cache_max_count = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] image_volume_cache_max_size_gb = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] init_host_max_objects_retrieval = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] instance_format = [instance: %(uuid)s] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] iscsi_target_flags = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] iscsi_write_cache = on {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] iser_helper = tgtadm {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] iser_ip_address = 192.168.122.227 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] iser_port = 3260 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] log_color = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] log_config_append = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] log_dir = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] log_file = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] log_options = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] log_rotate_interval = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] log_rotate_interval_type = days {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] log_rotation_type = none {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] max_age = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] max_logfile_count = 30 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] max_logfile_size_mb = 200 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] max_over_subscription_ratio = 20.0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] message_reap_interval = 86400 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] message_ttl = 2592000 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] migration_create_volume_timeout_secs = 300 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] monkey_patch = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] monkey_patch_modules = [] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] my_ip = 192.168.122.227 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] no_snapshot_gb_quota = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] num_iser_scan_tries = 3 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] num_shell_tries = 3 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] num_volume_device_scan_tries = 3 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] nvmeof_conn_info_version = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] nvmet_ns_id = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] nvmet_port_id = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] osapi_max_limit = 1000 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] osapi_volume_ext_list = [] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] osapi_volume_listen_port = 8776 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] osapi_volume_use_ssl = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] osapi_volume_workers = 2 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] per_volume_size_limit = -1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] periodic_fuzzy_delay = 60 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] periodic_interval = 60 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] public_endpoint = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] publish_errors = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] quota_backup_gigabytes = 1000 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] quota_backups = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] quota_gigabytes = 1000 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] quota_groups = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] quota_snapshots = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] quota_volumes = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] rate_limit_burst = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] rate_limit_except_level = CRITICAL {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] rate_limit_interval = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] reinit_driver_count = 3 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] replication_device = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] report_discard_supported = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:27 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] report_interval = 120 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] reservation_clean_interval = 86400 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] reservation_expire = 86400 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] reserved_image_namespaces = [] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] reserved_percentage = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] rpc_response_timeout = 120 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] run_external_periodic_tasks = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] scst_target_driver = iscsi {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] scst_target_iqn_name = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] service_down_time = 720 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] shell_completion = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] snapshot_name_template = snapshot-%s {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] snapshot_same_host = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] split_loggers = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] state_path = /opt/stack/data/cinder {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] storage_availability_zone = nova {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] storage_protocol = iSCSI {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] syslog_log_facility = LOG_USER {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] target_helper = lioadm {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] target_ip_address = 192.168.122.227 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:27 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] target_port = 3260 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] target_protocol = iscsi {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] target_secondary_ip_addresses = [] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] trace_flags = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] transport_url = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] until_refresh = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] use_chap_auth = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] use_default_quota_class = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] use_journal = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] use_json = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] use_multipath_for_image_xfer = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] use_stderr = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] use_syslog = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] verify_glance_signatures = enabled {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volume_api_class = cinder.volume.api.API {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volume_backend_name = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volume_clear = zero {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volume_clear_ionice = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volume_clear_size = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volume_copy_bps_limit = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volume_dd_blocksize = 1M {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volume_name_template = volume-%s {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volume_service_inithost_offload = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volume_usage_audit_period = month {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack sudo[76042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 04 13:09:27 devstack sudo[76042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] zoning_mode = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_concurrency.disable_process_locking = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.admin_password = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.admin_token = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.admin_user = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.auth_port = 35357 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.auth_protocol = https {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.auth_section = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.auth_type = password {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.auth_uri = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.auth_version = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.cache = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.certfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.identity_uri = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.include_service_catalog = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.insecure = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.interface = public {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.keyfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_password = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcache_username = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.region_name = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.service_type = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.227/identity {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.backend = dogpile.cache.null {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.backend_argument = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.backend_expiration_time = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.config_prefix = cache.oslo {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.debug_cache_backend = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.enable_retry_client = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.enable_socket_keepalive = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.enabled = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.enforce_fips_mode = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.expiration_time = 600 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.hashclient_retry_attempts = 2 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.memcache_dead_retry = 300 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.memcache_pool_maxsize = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.memcache_sasl_enabled = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.password = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.proxies = [] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.redis_db = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.redis_server = localhost:6379 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.retry_attempts = 2 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.retry_delay = 0.0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.socket_keepalive_count = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.socket_keepalive_idle = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.socket_keepalive_interval = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.socket_timeout = 1.0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.tls_allowed_ciphers = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.tls_cafile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.tls_certfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.tls_enabled = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.tls_keyfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cache.username = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.asyncio_connection = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.asyncio_slave_connection = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.backend = sqlalchemy {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.connection = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.connection_debug = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.connection_parameters = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.connection_recycle_time = 3600 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.connection_trace = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.db_inc_retry_interval = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.db_max_retries = 20 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.db_max_retry_interval = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.db_retry_interval = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.max_overflow = 50 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.max_pool_size = 5 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.max_retries = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.mysql_wsrep_sync_wait = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.pool_timeout = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.retry_interval = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.slave_connection = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.sqlite_synchronous = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:27 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.synchronous_reader = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] database.use_db_reconnect = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler.connection_string = messaging:// {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler.enabled = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler.es_doc_type = notification {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler.es_scroll_size = 10000 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler.es_scroll_time = 2m {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler.filter_error_trace = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler.hmac_keys = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler.sentinel_service_name = mymaster {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler.socket_timeout = 0.1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler.trace_requests = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler.trace_sqlalchemy = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler_jaeger.process_tags = {} {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler_jaeger.service_name_prefix = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] profiler_otlp.service_name_prefix = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_policy.enforce_new_defaults = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: WARNING oslo_config.cfg [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_policy.enforce_scope = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_policy.policy_default_rule = default {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_policy.policy_file = policy.yaml {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] coordination.backend_url = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] privsep_osbrick.group = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] privsep_osbrick.helper_command = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] privsep_osbrick.user = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cinder_sys_admin.group = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cinder_sys_admin.helper_command = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] cinder_sys_admin.user = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] service_user.auth_section = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] service_user.auth_type = password {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] service_user.cafile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] service_user.certfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] service_user.collect_timing = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] service_user.insecure = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] service_user.keyfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] service_user.send_service_user_token = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] service_user.split_loggers = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] service_user.timeout = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance.auth_section = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance.auth_type = password {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance.certfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance.collect_timing = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance.insecure = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance.keyfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance.region_name = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance.split_loggers = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] glance.timeout = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.backend_availability_zone = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.chap_password = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.chap_username = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.disk_geometry = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.driver_client_cert = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.driver_client_cert_key = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.driver_data_namespace = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.driver_use_ssl = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.extra_capabilities = {} {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.filter_function = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.goodness_function = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.iscsi_target_flags = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.iscsi_write_cache = on {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.iser_helper = tgtadm {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.iser_ip_address = 192.168.122.227 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.iser_port = 3260 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.lvm_share_target = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.lvm_type = auto {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.num_shell_tries = 3 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.replication_device = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.report_discard_supported = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.reserved_percentage = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.target_helper = tgtadm {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.target_ip_address = 192.168.122.227 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.target_port = 3260 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.target_protocol = iscsi {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.trace_flags = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.unique_fqdn_network = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.use_chap_auth = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.volume_backend_name = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.volume_clear = zero {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.volume_clear_ionice = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.volume_clear_size = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_reports.file_event_handler = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_reports.log_dir = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.backend_host = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.chap_password = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.chap_username = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.disk_geometry = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.driver_client_cert = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.extra_capabilities = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.filter_function = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.goodness_function = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.iser_helper = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.iser_ip_address = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.iser_port = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.lvm_share_target = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.lvm_type = auto {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.num_shell_tries = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.replication_device = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.report_discard_supported = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.reserved_percentage = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.scst_target_driver = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.storage_protocol = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.target_helper = lioadm {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.target_ip_address = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.target_port = 3260 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.trace_flags = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.use_chap_auth = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.volume_clear = zero {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.volume_clear_size = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] lvmdriver-1.volumes_dir = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.ssl = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_notifications.driver = [] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_notifications.retry = -1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] key_manager.fixed_key = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.barbican_api_version = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.barbican_endpoint = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.barbican_endpoint_type = public {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.barbican_region_name = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.cafile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.certfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.collect_timing = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.insecure = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.keyfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.number_of_retries = 60 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.retry_delay = 1 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.send_service_user_token = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.split_loggers = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.timeout = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.verify_ssl = True {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican.verify_ssl_path = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican_service_user.auth_section = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican_service_user.auth_type = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican_service_user.cafile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican_service_user.certfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican_service_user.collect_timing = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican_service_user.insecure = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican_service_user.keyfile = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican_service_user.split_loggers = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] barbican_service_user.timeout = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] vault.approle_role_id = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] vault.approle_secret_id = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] vault.kv_mountpoint = secret {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] vault.kv_path = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] vault.kv_version = 2 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] vault.namespace = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] vault.root_token_id = **** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] vault.ssl_ca_crt_file = None {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] vault.timeout = 60.0 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] vault.use_ssl = False {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack sudo[76042]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:09:28 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] ******************************************************************************** {{(pid=75830) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 04 13:09:28 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.863s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:28 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:28 devstack sudo[76166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:09:28 devstack sudo[76166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:29 devstack sudo[76166]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:29 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.641s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:29 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:09:29 devstack cinder-volume[76038]: INFO cinder.brick.local_dev.lvm [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 04 13:09:29 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:29 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:29 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:29 devstack sudo[76380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 13:09:29 devstack sudo[76380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:29 devstack sudo[76380]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:29 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:29 devstack cinder-volume[76038]: DEBUG cinder.brick.local_dev.lvm [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76038) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 04 13:09:29 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:29 devstack sudo[76605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:09:29 devstack sudo[76605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:31 devstack sudo[76605]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:31 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.301s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:31 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:31 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:31 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:31 devstack sudo[76790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:09:31 devstack sudo[76790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:32 devstack sudo[76790]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:32 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.896s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:32 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:32 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:32 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:32 devstack sudo[76820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 04 13:09:32 devstack sudo[76820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:32 devstack sudo[76820]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:32 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.698s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:32 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:32 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 13:09:32 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:33 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:33 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:33 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:33 devstack sudo[76828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 13:09:33 devstack sudo[76828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:34 devstack sudo[76828]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:34 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:34 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:34 devstack sudo[76831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:09:34 devstack sudo[76831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:34 devstack sudo[76831]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:34 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:34 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:34 devstack sudo[76836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:09:34 devstack sudo[76836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:35 devstack sudo[76836]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:35 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.750s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:35 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:35 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:35 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:35 devstack sudo[76844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:09:35 devstack sudo[76844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:36 devstack sudo[76844]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:36 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.828s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:36 devstack cinder-volume[76038]: INFO cinder.volume.drivers.lvm [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 04 13:09:36 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:36 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:36 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:36 devstack sudo[76889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:09:36 devstack sudo[76889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:37 devstack sudo[76889]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:37 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.716s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:37 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 13:09:37 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:37 devstack sudo[76968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 13:09:37 devstack sudo[76968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:37 devstack cinder-volume[75830]: DEBUG dbcounter [-] [75830] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75830) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:09:37 devstack sudo[76968]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:37 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:37 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:37 devstack sudo[77117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:09:37 devstack sudo[77117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:38 devstack sudo[77117]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:38 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.596s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:38 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:38 devstack sudo[77120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:09:38 devstack sudo[77120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:39 devstack sudo[77120]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:39 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.615s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:39 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:39 devstack sudo[77126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:09:39 devstack sudo[77126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:39 devstack sudo[77126]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:39 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.591s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:39 devstack cinder-volume[76038]: INFO cinder.volume.driver [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Driver hasn't implemented _init_vendor_properties() Jun 04 13:09:39 devstack cinder-volume[76038]: DEBUG cinder.volume.driver [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76038) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 04 13:09:39 devstack cinder-volume[76038]: DEBUG oslo_db.sqlalchemy.engines [None req-188e9e08-524a-4325-9098-e99464716e75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76038) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:09:39 devstack cinder-volume[76038]: DEBUG dbcounter [-] [76038] Writer thread running {{(pid=76038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 13:09:39 devstack cinder-volume[76038]: DEBUG cinder.db.sqlalchemy.api [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Building query based on filter {{(pid=76038) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 04 13:09:39 devstack cinder-volume[76038]: DEBUG cinder.image.image_utils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76038) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 04 13:09:39 devstack cinder-volume[76038]: INFO cinder.keymgr.migration [None req-2778ed65-89a9-49bf-ba37-e46c03b6f538 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 04 13:09:39 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 13:09:39 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:39 devstack sudo[77130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 13:09:39 devstack sudo[77130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:40 devstack sudo[77130]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:40 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.568s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:40 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:40 devstack sudo[77133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:09:40 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:40 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:40 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:40 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:40 devstack sudo[77136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:09:40 devstack sudo[77136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:41 devstack sudo[77136]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.618s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:41 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:41 devstack sudo[77141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:09:41 devstack sudo[77141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:42 devstack sudo[77141]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:42 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:42 devstack cinder-volume[76038]: DEBUG cinder.manager [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Notifying Schedulers of capabilities ... {{(pid=76038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:09:42 devstack cinder-volume[76038]: INFO cinder.volume.manager [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Driver initialization completed successfully. Jun 04 13:09:42 devstack cinder-volume[76038]: INFO cinder.manager [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Initiating service 2 cleanup Jun 04 13:09:42 devstack cinder-volume[76038]: INFO cinder.manager [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Service 2 cleanup completed. Jun 04 13:09:42 devstack cinder-volume[76038]: DEBUG cinder.service [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Creating RPC server for service cinder-volume {{(pid=76038) start /opt/stack/cinder/cinder/service.py:231}} Jun 04 13:09:42 devstack cinder-volume[76038]: DEBUG cinder.service [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76038) start /opt/stack/cinder/cinder/service.py:237}} Jun 04 13:09:42 devstack cinder-volume[76038]: INFO cinder.volume.manager [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 04 13:09:42 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 13:09:42 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:42 devstack sudo[77147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 13:09:42 devstack sudo[77147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:43 devstack sudo[77147]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:43 devstack sudo[77151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:09:43 devstack sudo[77151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:43 devstack sudo[77151]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:43 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:43 devstack sudo[77154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:09:43 devstack sudo[77154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:44 devstack sudo[77154]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:44 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:44 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:09:44 devstack sudo[77211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:09:44 devstack sudo[77211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:09:44 devstack sudo[77211]: pam_unix(sudo:session): session closed for user root Jun 04 13:09:44 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-188e9e08-524a-4325-9098-e99464716e75 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:09:44 devstack cinder-volume[76038]: INFO cinder.volume.manager [None req-188e9e08-524a-4325-9098-e99464716e75 None None] Driver post RPC initialization completed successfully. Jun 04 13:09:54 devstack cinder-volume[76038]: DEBUG dbcounter [-] [76038] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:09:54 devstack cinder-volume[76038]: DEBUG dbcounter [-] [76038] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:09:54 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running periodic task VolumeManager._thread_info {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:09:54 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] thread count: 6 {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:09:54 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] thread info: [<_MainThread(MainThread, started 128405231288448)>, , , , , ] {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:10:54 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:10:54 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 13:10:54 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:10:54 devstack sudo[79416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 13:10:54 devstack sudo[79416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:10:55 devstack sudo[79416]: pam_unix(sudo:session): session closed for user root Jun 04 13:10:55 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:10:55 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:10:55 devstack sudo[79419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:10:55 devstack sudo[79419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:10:56 devstack sudo[79419]: pam_unix(sudo:session): session closed for user root Jun 04 13:10:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.577s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:10:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:10:56 devstack sudo[79422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:10:56 devstack sudo[79422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:10:56 devstack sudo[79422]: pam_unix(sudo:session): session closed for user root Jun 04 13:10:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.568s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:10:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:10:56 devstack sudo[79426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:10:56 devstack sudo[79426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:10:57 devstack sudo[79426]: pam_unix(sudo:session): session closed for user root Jun 04 13:10:57 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:10:57 devstack cinder-volume[76038]: DEBUG cinder.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Notifying Schedulers of capabilities ... {{(pid=76038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:10:57 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running periodic task VolumeManager._thread_info {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:10:57 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] thread count: 6 {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:10:57 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] thread info: [<_MainThread(MainThread, started 128405231288448)>, , , , , ] {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:11:54 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:11:54 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 13:11:54 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:11:54 devstack cinder-volume[76038]: DEBUG dbcounter [-] [76038] Writing DB stats cinder:SELECT=1 {{(pid=76038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:11:54 devstack cinder-volume[76038]: DEBUG dbcounter [-] [76038] Writing DB stats cinder:UPDATE=1 {{(pid=76038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:11:54 devstack sudo[82267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 13:11:54 devstack sudo[82267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:11:55 devstack sudo[82267]: pam_unix(sudo:session): session closed for user root Jun 04 13:11:55 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.590s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:11:55 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:11:55 devstack sudo[82270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:11:55 devstack sudo[82270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:11:56 devstack sudo[82270]: pam_unix(sudo:session): session closed for user root Jun 04 13:11:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:11:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:11:56 devstack sudo[82273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:11:56 devstack sudo[82273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:11:56 devstack sudo[82273]: pam_unix(sudo:session): session closed for user root Jun 04 13:11:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.599s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:11:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:11:56 devstack sudo[82277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:11:56 devstack sudo[82277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:11:57 devstack sudo[82277]: pam_unix(sudo:session): session closed for user root Jun 04 13:11:57 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.570s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:11:57 devstack cinder-volume[76038]: DEBUG cinder.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Notifying Schedulers of capabilities ... {{(pid=76038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:11:57 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running periodic task VolumeManager._thread_info {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:11:57 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] thread count: 6 {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:11:57 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] thread info: [<_MainThread(MainThread, started 128405231288448)>, , , , , ] {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:12:54 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:12:54 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 13:12:54 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:12:54 devstack sudo[84345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 13:12:54 devstack sudo[84345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:12:55 devstack sudo[84345]: pam_unix(sudo:session): session closed for user root Jun 04 13:12:55 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:12:55 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:12:55 devstack sudo[84349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:12:55 devstack sudo[84349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:12:56 devstack sudo[84349]: pam_unix(sudo:session): session closed for user root Jun 04 13:12:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:12:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:12:56 devstack sudo[84352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:12:56 devstack sudo[84352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:12:56 devstack sudo[84352]: pam_unix(sudo:session): session closed for user root Jun 04 13:12:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:12:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:12:56 devstack sudo[84367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:12:56 devstack sudo[84367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:12:57 devstack sudo[84367]: pam_unix(sudo:session): session closed for user root Jun 04 13:12:57 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:12:57 devstack cinder-volume[76038]: DEBUG cinder.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Notifying Schedulers of capabilities ... {{(pid=76038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:12:57 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running periodic task VolumeManager._thread_info {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:12:57 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] thread count: 6 {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:12:57 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] thread info: [<_MainThread(MainThread, started 128405231288448)>, , , , , ] {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:13:54 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:13:54 devstack cinder-volume[76038]: DEBUG cinder.volume.drivers.lvm [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Updating volume stats {{(pid=76038) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 04 13:13:54 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:13:54 devstack cinder-volume[76038]: DEBUG dbcounter [-] [76038] Writing DB stats cinder:SELECT=1 {{(pid=76038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:13:54 devstack cinder-volume[76038]: DEBUG dbcounter [-] [76038] Writing DB stats cinder:UPDATE=1 {{(pid=76038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:13:54 devstack sudo[85289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 04 13:13:54 devstack sudo[85289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:13:55 devstack sudo[85289]: pam_unix(sudo:session): session closed for user root Jun 04 13:13:55 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.595s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:13:55 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:13:55 devstack sudo[85303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:13:55 devstack sudo[85303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:13:56 devstack sudo[85303]: pam_unix(sudo:session): session closed for user root Jun 04 13:13:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:13:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:13:56 devstack sudo[85329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 04 13:13:56 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:13:56 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root Jun 04 13:13:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.613s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:13:56 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:13:56 devstack sudo[85336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 04 13:13:56 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:13:57 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root Jun 04 13:13:57 devstack cinder-volume[76038]: DEBUG oslo_concurrency.processutils [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=76038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:13:57 devstack cinder-volume[76038]: DEBUG cinder.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Notifying Schedulers of capabilities ... {{(pid=76038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:13:57 devstack cinder-volume[76038]: DEBUG oslo_service.periodic_task [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] Running periodic task VolumeManager._thread_info {{(pid=76038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:13:57 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] thread count: 6 {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:13:57 devstack cinder-volume[76038]: DEBUG cinder.volume.manager [None req-b1ae988d-7d3e-40b5-8568-97397b1f74e6 None None] thread info: [<_MainThread(MainThread, started 128405231288448)>, , , , , ] {{(pid=76038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:14:09 devstack cinder-volume[75830]: INFO oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Caught SIGTERM, stopping children Jun 04 13:14:09 devstack cinder-volume[75830]: DEBUG oslo_concurrency.lockutils [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Acquiring lock "singleton_lock" {{(pid=75830) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 13:14:09 devstack cinder-volume[75830]: DEBUG oslo_concurrency.lockutils [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Acquired lock "singleton_lock" {{(pid=75830) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 13:14:09 devstack cinder-volume[75830]: DEBUG oslo_concurrency.lockutils [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Releasing lock "singleton_lock" {{(pid=75830) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 13:14:09 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Stop services. {{(pid=75830) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 04 13:14:09 devstack cinder-volume[75830]: DEBUG oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Killing children. {{(pid=75830) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 04 13:14:09 devstack cinder-volume[75830]: INFO oslo_service.backend._eventlet.service [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Waiting on 1 children to exit Jun 04 13:14:14 devstack cinder-volume[76038]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 04 13:14:16 devstack cinder-volume[85718]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85718) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 13:14:16 devstack cinder-volume[85718]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85718) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 13:14:16 devstack cinder-volume[85718]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85718) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 13:14:17 devstack cinder-volume[76038]: DEBUG oslo_concurrency.lockutils [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Acquiring lock "singleton_lock" {{(pid=76038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 13:14:17 devstack cinder-volume[76038]: DEBUG oslo_concurrency.lockutils [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Acquired lock "singleton_lock" {{(pid=76038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 13:14:17 devstack cinder-volume[76038]: DEBUG oslo_concurrency.lockutils [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Releasing lock "singleton_lock" {{(pid=76038) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 13:14:17 devstack cinder-volume[76038]: WARNING amqp [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 04 13:14:17 devstack cinder-volume[76038]: WARNING amqp [None req-5d931286-ff4f-4180-bb49-3930aa7117b2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 04 13:14:17 devstack cinder-volume[85718]: INFO dbcounter [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Registered counter for database cinder Jun 04 13:14:17 devstack cinder-volume[85718]: DEBUG oslo_db.sqlalchemy.engines [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85718) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:14:17 devstack cinder-volume[85718]: DEBUG dbcounter [-] [85718] Writer thread running {{(pid=85718) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 13:14:17 devstack cinder-volume[85718]: INFO cinder.rpc [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 04 13:14:17 devstack cinder-volume[85718]: INFO cinder.rpc [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 04 13:14:17 devstack cinder-volume[85718]: DEBUG oslo_db.sqlalchemy.engines [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85718) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:14:18 devstack cinder-volume[85718]: INFO cinder.volume.manager [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Determined volume DB was empty at startup. Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG cinder.volume.manager [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85718) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 04 13:14:18 devstack cinder-volume[85718]: INFO cinder.volume.manager [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 04 13:14:18 devstack cinder-volume[85718]: WARNING stevedore.named [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 13:14:18 devstack cinder-volume[85718]: WARNING castellan.key_manager [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 13:14:18 devstack cinder-volume[85718]: WARNING cinder.keymgr.conf_key_mgr [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 13:14:18 devstack cinder-volume[85718]: INFO cinder.volume.manager [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_db.sqlalchemy.engines [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85718) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:14:18 devstack cinder-volume[85718]: INFO oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Starting 1 workers Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Started child 85967 {{(pid=85718) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Full set of CONF: {{(pid=85718) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] ******************************************************************************** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Configuration options gathered from: {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] ================================================================================ {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] allow_availability_zone_fallback = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] allow_compression_on_image_upload = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] allowed_direct_url_schemes = [] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85967]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] api_rate_limit = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] auth_strategy = keystone {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_availability_zone = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_host = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_name = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_stats_polling_interval = 60 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backup_api_class = cinder.backup.api.API {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backup_name_template = backup-%s {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backup_use_same_host = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backup_use_temp_snapshot = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] chap_password = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] chap_username = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cinder_internal_tenant_project_id = 069b2c6f5a5849baab57437f63c9d935 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cinder_internal_tenant_user_id = 85d3096e90ae49e7b63698861e277543 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cluster = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] compression_format = gzip {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] compute_api_class = cinder.compute.nova.API {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] config_dir = [] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] config_source = [] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] control_exchange = openstack {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] debug = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] default_availability_zone = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] default_group_type = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] default_volume_type = QuobyteHD {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] disk_geometry = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] driver_client_cert = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] driver_client_cert_key = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] driver_data_namespace = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] driver_ssl_cert_path = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] driver_ssl_cert_verify = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] driver_use_ssl = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] enable_new_services = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] enable_unsupported_driver = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] enabled_backends = ['QuobyteHD'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] enforce_multipath_for_image_xfer = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] filter_function = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance_api_insecure = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance_api_servers = ['http://192.168.122.227/image'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance_api_ssl_compression = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance_ca_certificates_file = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance_catalog_info = image:glance:publicURL {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance_certfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance_keyfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance_num_retries = 3 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance_request_timeout = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] goodness_function = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] graceful_shutdown_timeout = 5 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] group_api_class = cinder.group.api.API {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] host = devstack {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] image_compress_on_upload = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] image_conversion_address_space_limit = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] image_conversion_cpu_limit = 60 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] image_conversion_disable = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] image_upload_use_cinder_backend = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] image_upload_use_internal_tenant = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] image_volume_cache_enabled = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] image_volume_cache_max_count = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] image_volume_cache_max_size_gb = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] init_host_max_objects_retrieval = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] instance_format = [instance: %(uuid)s] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85967]: INFO cinder.volume.manager [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] iscsi_target_flags = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85967]: DEBUG cinder.volume.drivers.remotefs [None req-47523307-53bc-4331-9246-a1d801437e99 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85967) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] iscsi_write_cache = on {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] iser_helper = tgtadm {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] iser_ip_address = 192.168.122.227 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] iser_port = 3260 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] log_color = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] log_config_append = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] log_dir = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] log_file = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] log_options = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] log_rotate_interval = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] log_rotate_interval_type = days {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] log_rotation_type = none {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] max_age = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] max_logfile_count = 30 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] max_logfile_size_mb = 200 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] max_over_subscription_ratio = 20.0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] message_reap_interval = 86400 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] message_ttl = 2592000 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] migration_create_volume_timeout_secs = 300 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] monkey_patch = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] monkey_patch_modules = [] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] my_ip = 192.168.122.227 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] no_snapshot_gb_quota = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] num_iser_scan_tries = 3 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] num_shell_tries = 3 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] num_volume_device_scan_tries = 3 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] nvmeof_conn_info_version = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] nvmet_ns_id = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] nvmet_port_id = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] osapi_max_limit = 1000 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] osapi_volume_ext_list = [] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] osapi_volume_listen_port = 8776 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] osapi_volume_use_ssl = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] osapi_volume_workers = 2 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] per_volume_size_limit = -1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] periodic_fuzzy_delay = 60 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] periodic_interval = 60 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] public_endpoint = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] publish_errors = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] quota_backup_gigabytes = 1000 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] quota_backups = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] quota_gigabytes = 1000 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] quota_groups = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] quota_snapshots = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] quota_volumes = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] rate_limit_burst = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] rate_limit_except_level = CRITICAL {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] rate_limit_interval = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] reinit_driver_count = 3 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] replication_device = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] report_discard_supported = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] report_interval = 120 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] reservation_clean_interval = 86400 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] reservation_expire = 86400 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] reserved_image_namespaces = [] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] reserved_percentage = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] rpc_response_timeout = 120 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] run_external_periodic_tasks = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] scst_target_driver = iscsi {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] scst_target_iqn_name = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] service_down_time = 720 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] shell_completion = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] snapshot_name_template = snapshot-%s {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] split_loggers = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] state_path = /opt/stack/data/cinder {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] storage_availability_zone = nova {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] storage_protocol = iSCSI {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] syslog_log_facility = LOG_USER {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] target_helper = lioadm {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] target_ip_address = 192.168.122.227 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] target_port = 3260 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] target_protocol = iscsi {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] target_secondary_ip_addresses = [] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] trace_flags = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] transport_url = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] until_refresh = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] use_chap_auth = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] use_default_quota_class = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] use_journal = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] use_json = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] use_multipath_for_image_xfer = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] use_stderr = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] use_syslog = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] verify_glance_signatures = enabled {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volume_api_class = cinder.volume.api.API {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volume_backend_name = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volume_clear = zero {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volume_clear_ionice = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volume_clear_size = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volume_copy_bps_limit = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volume_dd_blocksize = 1M {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volume_name_template = volume-%s {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volume_service_inithost_offload = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volume_usage_audit_period = month {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] zoning_mode = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_concurrency.disable_process_locking = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.admin_password = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.admin_token = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.admin_user = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.auth_admin_prefix = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.auth_port = 35357 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.auth_protocol = https {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.auth_section = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.auth_type = password {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.auth_uri = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.auth_version = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.cache = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.certfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.identity_uri = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.include_service_catalog = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.insecure = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.interface = public {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.keyfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_password = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcache_username = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.region_name = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.service_token_roles_required = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.service_type = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.227/identity {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.backend = dogpile.cache.null {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.backend_argument = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.backend_expiration_time = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.config_prefix = cache.oslo {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.debug_cache_backend = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.enable_retry_client = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.enable_socket_keepalive = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.enabled = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85967]: DEBUG cinder.volume.drivers.quobyte [None req-47523307-53bc-4331-9246-a1d801437e99 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85967) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 04 13:14:18 devstack cinder-volume[85967]: WARNING cinder.volume.drivers.quobyte [None req-47523307-53bc-4331-9246-a1d801437e99 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 04 13:14:18 devstack cinder-volume[85967]: WARNING cinder.volume.drivers.quobyte [None req-47523307-53bc-4331-9246-a1d801437e99 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.enforce_fips_mode = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.expiration_time = 600 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85967]: DEBUG oslo_concurrency.processutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Running cmd (subprocess): mount.quobyte {{(pid=85967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.hashclient_retry_attempts = 2 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.memcache_dead_retry = 300 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.memcache_pool_maxsize = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.memcache_sasl_enabled = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.password = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.proxies = [] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.redis_db = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.redis_server = localhost:6379 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.retry_attempts = 2 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.retry_delay = 0.0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.socket_keepalive_count = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.socket_keepalive_idle = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.socket_keepalive_interval = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.socket_timeout = 1.0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.tls_allowed_ciphers = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.tls_cafile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.tls_certfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.tls_enabled = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.tls_keyfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cache.username = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.asyncio_connection = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.asyncio_slave_connection = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.backend = sqlalchemy {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.connection = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.connection_debug = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.connection_parameters = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.connection_recycle_time = 3600 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.connection_trace = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.db_inc_retry_interval = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.db_max_retries = 20 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.db_max_retry_interval = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.db_retry_interval = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.max_overflow = 50 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.max_pool_size = 5 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.max_retries = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.mysql_wsrep_sync_wait = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.pool_timeout = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.retry_interval = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.slave_connection = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.sqlite_synchronous = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.synchronous_reader = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] database.use_db_reconnect = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler.connection_string = messaging:// {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler.enabled = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler.es_doc_type = notification {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler.es_scroll_size = 10000 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler.es_scroll_time = 2m {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler.filter_error_trace = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler.hmac_keys = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler.sentinel_service_name = mymaster {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler.socket_timeout = 0.1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler.trace_requests = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler.trace_sqlalchemy = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler_jaeger.process_tags = {} {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler_jaeger.service_name_prefix = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] profiler_otlp.service_name_prefix = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_policy.enforce_new_defaults = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: WARNING oslo_config.cfg [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_policy.enforce_scope = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_policy.policy_default_rule = default {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_policy.policy_file = policy.yaml {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] coordination.backend_url = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] privsep_osbrick.group = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] privsep_osbrick.helper_command = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] privsep_osbrick.user = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cinder_sys_admin.group = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cinder_sys_admin.helper_command = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] cinder_sys_admin.user = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] service_user.auth_section = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] service_user.auth_type = password {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] service_user.cafile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] service_user.certfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] service_user.collect_timing = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] service_user.insecure = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] service_user.keyfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] service_user.send_service_user_token = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] service_user.split_loggers = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] service_user.timeout = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance.auth_section = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance.auth_type = password {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance.certfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance.collect_timing = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance.insecure = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance.keyfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance.region_name = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance.split_loggers = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] glance.timeout = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.backend_availability_zone = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.chap_password = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.chap_username = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.disk_geometry = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.driver_client_cert = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.driver_client_cert_key = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.driver_data_namespace = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.driver_use_ssl = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.extra_capabilities = {} {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.filter_function = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.goodness_function = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.iscsi_target_flags = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.iscsi_write_cache = on {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.iser_helper = tgtadm {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.iser_ip_address = 192.168.122.227 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.iser_port = 3260 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nas_host = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nas_login = admin {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nas_mount_options = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nas_password = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nas_private_key = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nas_share_path = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.num_shell_tries = 3 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.quobyte_volume_url = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.replication_device = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.report_discard_supported = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.reserved_percentage = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.target_helper = tgtadm {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.target_ip_address = 192.168.122.227 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.target_port = 3260 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.target_protocol = iscsi {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.trace_flags = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.unique_fqdn_network = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.use_chap_auth = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.volume_backend_name = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.volume_clear = zero {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.volume_clear_ionice = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.volume_clear_size = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_reports.file_event_handler = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_reports.log_dir = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.backend_availability_zone = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.backend_host = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.chap_password = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.chap_username = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.chiscsi_conf = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.disk_geometry = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.driver_client_cert = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.driver_data_namespace = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.driver_use_ssl = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.extra_capabilities = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.filter_function = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.goodness_function = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.iser_helper = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.iser_ip_address = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.iser_port = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.iser_target_prefix = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nas_host = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nas_login = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nas_mount_options = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nas_password = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nas_private_key = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nas_share_path = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nas_ssh_port = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85967]: DEBUG oslo_concurrency.processutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] CMD "mount.quobyte" returned: 1 in 0.151s {{(pid=85967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.num_shell_tries = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.nvmet_port_id = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:14:18 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:14:18 devstack cinder-volume[85967]: DEBUG cinder.volume.drivers.quobyte [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=85967) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:14:18 devstack cinder-volume[85967]: INFO cinder.volume.drivers.quobyte [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 ... Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.replication_device = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.report_discard_supported = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.reserved_percentage = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.scst_target_driver = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85967]: DEBUG oslo_concurrency.processutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c -c /etc/quobyte/client-cinder.cfg {{(pid=85967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.storage_protocol = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.target_helper = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.target_ip_address = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.target_port = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.target_prefix = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.target_protocol = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.trace_flags = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.use_chap_auth = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.volume_clear = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.volume_clear_size = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] QuobyteHD.volumes_dir = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.ssl = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_notifications.driver = [] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_notifications.retry = -1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] key_manager.fixed_key = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.barbican_api_version = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.barbican_endpoint = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.barbican_endpoint_type = public {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.barbican_region_name = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.cafile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.certfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.collect_timing = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.insecure = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.keyfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.number_of_retries = 60 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.retry_delay = 1 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack sudo[85981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c -c /etc/quobyte/client-cinder.cfg Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.send_service_user_token = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.split_loggers = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.timeout = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.verify_ssl = True {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican.verify_ssl_path = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican_service_user.auth_section = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican_service_user.auth_type = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican_service_user.cafile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican_service_user.certfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican_service_user.collect_timing = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican_service_user.insecure = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican_service_user.keyfile = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican_service_user.split_loggers = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] barbican_service_user.timeout = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] vault.approle_role_id = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] vault.approle_secret_id = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] vault.kv_mountpoint = secret {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] vault.kv_path = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] vault.kv_version = 2 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] vault.namespace = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] vault.root_token_id = **** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] vault.ssl_ca_crt_file = None {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] vault.timeout = 60.0 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] vault.use_ssl = False {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:18 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] ******************************************************************************** {{(pid=85718) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 04 13:14:19 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root Jun 04 13:14:19 devstack cinder-volume[85967]: DEBUG oslo_concurrency.processutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.811s {{(pid=85967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:14:19 devstack cinder-volume[85967]: INFO cinder.volume.drivers.quobyte [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 succeeded Jun 04 13:14:19 devstack cinder-volume[85967]: DEBUG cinder.volume.drivers.quobyte [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=85967) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:14:19 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.825s {{(pid=85967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:14:19 devstack cinder-volume[85967]: DEBUG oslo_concurrency.processutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=85967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:14:19 devstack sudo[86057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:14:19 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:14:19 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root Jun 04 13:14:19 devstack cinder-volume[85967]: DEBUG oslo_concurrency.processutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.602s {{(pid=85967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:14:19 devstack cinder-volume[85967]: INFO cinder.volume.driver [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Driver hasn't implemented _init_vendor_properties() Jun 04 13:14:19 devstack cinder-volume[85967]: DEBUG cinder.volume.driver [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579879760742, 'free_capacity_gb': 1775.7579879760742, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85967) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG oslo_db.sqlalchemy.engines [None req-47523307-53bc-4331-9246-a1d801437e99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85967) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG dbcounter [-] [85967] Writer thread running {{(pid=85967) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG cinder.db.sqlalchemy.api [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Building query based on filter {{(pid=85967) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG cinder.image.image_utils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85967) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 04 13:14:20 devstack cinder-volume[85967]: INFO cinder.keymgr.migration [None req-c3cfdfe9-e7a4-4e2e-a325-031e016b577a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG cinder.volume.drivers.quobyte [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=85967) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG cinder.volume.drivers.quobyte [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=85967) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG oslo_concurrency.processutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=85967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:14:20 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:14:20 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:14:20 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG oslo_concurrency.processutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.638s {{(pid=85967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG cinder.manager [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Notifying Schedulers of capabilities ... {{(pid=85967) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:14:20 devstack cinder-volume[85967]: INFO cinder.volume.manager [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Driver initialization completed successfully. Jun 04 13:14:20 devstack cinder-volume[85967]: INFO cinder.manager [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Initiating service 3 cleanup Jun 04 13:14:20 devstack cinder-volume[85967]: INFO cinder.manager [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Service 3 cleanup completed. Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG cinder.service [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Creating RPC server for service cinder-volume {{(pid=85967) start /opt/stack/cinder/cinder/service.py:231}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG cinder.service [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85967) start /opt/stack/cinder/cinder/service.py:237}} Jun 04 13:14:20 devstack cinder-volume[85967]: INFO cinder.volume.manager [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG cinder.volume.drivers.quobyte [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=85967) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG cinder.volume.drivers.quobyte [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=85967) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:14:20 devstack cinder-volume[85967]: DEBUG oslo_concurrency.processutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=85967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:14:20 devstack sudo[86100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:14:20 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:14:21 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root Jun 04 13:14:21 devstack cinder-volume[85967]: DEBUG oslo_concurrency.processutils [None req-47523307-53bc-4331-9246-a1d801437e99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.822s {{(pid=85967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:14:21 devstack cinder-volume[85967]: INFO cinder.volume.manager [None req-47523307-53bc-4331-9246-a1d801437e99 None None] Driver post RPC initialization completed successfully. Jun 04 13:14:25 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-f4859825-9127-477b-8304-c41642958378 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:14:25 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-f4859825-9127-477b-8304-c41642958378 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:14:25 devstack cinder-volume[85967]: DEBUG cinder.volume.drivers.quobyte [None req-f4859825-9127-477b-8304-c41642958378 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=85967) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:14:25 devstack cinder-volume[85967]: DEBUG cinder.volume.drivers.quobyte [None req-f4859825-9127-477b-8304-c41642958378 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=85967) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:14:25 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-f4859825-9127-477b-8304-c41642958378 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:14:25 devstack cinder-volume[85967]: DEBUG oslo_concurrency.processutils [None req-f4859825-9127-477b-8304-c41642958378 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=85967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:14:25 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:14:25 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:14:25 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Jun 04 13:14:25 devstack cinder-volume[85967]: DEBUG oslo_concurrency.processutils [None req-f4859825-9127-477b-8304-c41642958378 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.572s {{(pid=85967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:14:25 devstack cinder-volume[85967]: DEBUG cinder.manager [None req-f4859825-9127-477b-8304-c41642958378 None None] Notifying Schedulers of capabilities ... {{(pid=85967) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:14:28 devstack cinder-volume[85718]: DEBUG dbcounter [-] [85718] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85718) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:14:28 devstack cinder-volume[85967]: DEBUG oslo_service.periodic_task [None req-1fac5d47-d5df-40f9-ab44-3cddba67d1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=85967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:14:28 devstack cinder-volume[85967]: DEBUG cinder.volume.manager [None req-1fac5d47-d5df-40f9-ab44-3cddba67d1a0 None None] thread count: 6 {{(pid=85967) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:14:28 devstack cinder-volume[85967]: DEBUG cinder.volume.manager [None req-1fac5d47-d5df-40f9-ab44-3cddba67d1a0 None None] thread info: [<_MainThread(MainThread, started 125746390335616)>, , , , , ] {{(pid=85967) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:14:29 devstack cinder-volume[85718]: INFO oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Caught SIGTERM, stopping children Jun 04 13:14:29 devstack cinder-volume[85718]: DEBUG oslo_concurrency.lockutils [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Acquiring lock "singleton_lock" {{(pid=85718) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 13:14:29 devstack cinder-volume[85718]: DEBUG oslo_concurrency.lockutils [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Acquired lock "singleton_lock" {{(pid=85718) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 13:14:29 devstack cinder-volume[85718]: DEBUG oslo_concurrency.lockutils [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Releasing lock "singleton_lock" {{(pid=85718) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 13:14:29 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Stop services. {{(pid=85718) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 04 13:14:29 devstack cinder-volume[85718]: DEBUG oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Killing children. {{(pid=85718) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 04 13:14:29 devstack cinder-volume[85718]: INFO oslo_service.backend._eventlet.service [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Waiting on 1 children to exit Jun 04 13:14:31 devstack cinder-volume[85967]: DEBUG dbcounter [-] [85967] Writing DB stats cinder:SELECT=4 {{(pid=85967) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:14:31 devstack cinder-volume[85967]: DEBUG dbcounter [-] [85967] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85967) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:14:34 devstack cinder-volume[85967]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 04 13:14:34 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Acquiring lock "singleton_lock" {{(pid=85967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 13:14:34 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Acquired lock "singleton_lock" {{(pid=85967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 13:14:34 devstack cinder-volume[85967]: DEBUG oslo_concurrency.lockutils [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Releasing lock "singleton_lock" {{(pid=85967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 13:14:34 devstack cinder-volume[85967]: WARNING amqp [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 04 13:14:34 devstack cinder-volume[85967]: WARNING amqp [None req-1f9c7879-62cb-49bc-9008-7be734c7f540 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 04 13:14:36 devstack cinder-volume[86477]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86477) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 04 13:14:36 devstack cinder-volume[86477]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86477) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 04 13:14:36 devstack cinder-volume[86477]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86477) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 04 13:14:37 devstack cinder-volume[86477]: INFO dbcounter [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Registered counter for database cinder Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_db.sqlalchemy.engines [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86477) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG dbcounter [-] [86477] Writer thread running {{(pid=86477) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 13:14:37 devstack cinder-volume[86477]: INFO cinder.rpc [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 04 13:14:37 devstack cinder-volume[86477]: INFO cinder.rpc [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_db.sqlalchemy.engines [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86477) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:14:37 devstack cinder-volume[86477]: INFO cinder.volume.manager [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Determined volume DB was empty at startup. Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG cinder.volume.manager [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86477) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 04 13:14:37 devstack cinder-volume[86477]: WARNING stevedore.named [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 04 13:14:37 devstack cinder-volume[86477]: WARNING castellan.key_manager [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 13:14:37 devstack cinder-volume[86477]: WARNING cinder.keymgr.conf_key_mgr [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 04 13:14:37 devstack cinder-volume[86477]: INFO cinder.volume.manager [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_db.sqlalchemy.engines [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86477) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:14:37 devstack cinder-volume[86477]: INFO oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Starting 1 workers Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Started child 86722 {{(pid=86477) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Full set of CONF: {{(pid=86477) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] ******************************************************************************** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Configuration options gathered from: {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] ================================================================================ {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] allow_availability_zone_fallback = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] allow_compression_on_image_upload = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] allowed_direct_url_schemes = [] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] api_rate_limit = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] auth_strategy = keystone {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_availability_zone = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86722]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_host = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_name = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_stats_polling_interval = 60 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backup_api_class = cinder.backup.api.API {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backup_name_template = backup-%s {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backup_use_same_host = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backup_use_temp_snapshot = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] chap_password = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] chap_username = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cinder_internal_tenant_project_id = 069b2c6f5a5849baab57437f63c9d935 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cinder_internal_tenant_user_id = 85d3096e90ae49e7b63698861e277543 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cluster = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] compression_format = gzip {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] compute_api_class = cinder.compute.nova.API {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] config_dir = [] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] config_source = [] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] control_exchange = openstack {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] debug = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] default_availability_zone = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] default_group_type = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] default_volume_type = QuobyteHD {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] disk_geometry = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] driver_client_cert = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] driver_client_cert_key = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] driver_data_namespace = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] driver_ssl_cert_path = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] driver_ssl_cert_verify = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] driver_use_ssl = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] enable_new_services = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] enable_unsupported_driver = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] enabled_backends = ['QuobyteHD'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] enforce_multipath_for_image_xfer = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] filter_function = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance_api_insecure = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance_api_servers = ['http://192.168.122.227/image'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance_api_ssl_compression = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance_ca_certificates_file = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance_catalog_info = image:glance:publicURL {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance_certfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance_keyfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance_num_retries = 3 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance_request_timeout = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] goodness_function = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] graceful_shutdown_timeout = 5 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] group_api_class = cinder.group.api.API {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] host = devstack {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] image_compress_on_upload = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] image_conversion_address_space_limit = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] image_conversion_cpu_limit = 60 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] image_conversion_disable = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] image_upload_use_cinder_backend = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] image_upload_use_internal_tenant = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] image_volume_cache_enabled = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] image_volume_cache_max_count = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] image_volume_cache_max_size_gb = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] init_host_max_objects_retrieval = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] instance_format = [instance: %(uuid)s] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] iscsi_target_flags = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] iscsi_write_cache = on {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] iser_helper = tgtadm {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] iser_ip_address = 192.168.122.227 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] iser_port = 3260 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] log_color = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] log_config_append = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] log_dir = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] log_file = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] log_options = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] log_rotate_interval = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] log_rotate_interval_type = days {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] log_rotation_type = none {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] max_age = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] max_logfile_count = 30 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] max_logfile_size_mb = 200 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] max_over_subscription_ratio = 20.0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] message_reap_interval = 86400 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] message_ttl = 2592000 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] migration_create_volume_timeout_secs = 300 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] monkey_patch = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] monkey_patch_modules = [] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] my_ip = 192.168.122.227 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] no_snapshot_gb_quota = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] num_iser_scan_tries = 3 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] num_shell_tries = 3 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] num_volume_device_scan_tries = 3 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] nvmeof_conn_info_version = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] nvmet_ns_id = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] nvmet_port_id = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] osapi_max_limit = 1000 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] osapi_volume_ext_list = [] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] osapi_volume_listen_port = 8776 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] osapi_volume_use_ssl = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] osapi_volume_workers = 2 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] per_volume_size_limit = -1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] periodic_fuzzy_delay = 60 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] periodic_interval = 60 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] public_endpoint = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] publish_errors = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] quota_backup_gigabytes = 1000 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] quota_backups = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] quota_gigabytes = 1000 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] quota_groups = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] quota_snapshots = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] quota_volumes = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] rate_limit_burst = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] rate_limit_except_level = CRITICAL {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] rate_limit_interval = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] reinit_driver_count = 3 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] replication_device = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] report_discard_supported = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] report_interval = 120 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] reservation_clean_interval = 86400 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] reservation_expire = 86400 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] reserved_image_namespaces = [] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] reserved_percentage = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86722) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] rpc_response_timeout = 120 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] run_external_periodic_tasks = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] scst_target_driver = iscsi {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] scst_target_iqn_name = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] service_down_time = 720 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] shell_completion = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] snapshot_name_template = snapshot-%s {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] split_loggers = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] state_path = /opt/stack/data/cinder {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] storage_availability_zone = nova {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] storage_protocol = iSCSI {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] syslog_log_facility = LOG_USER {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] target_helper = lioadm {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] target_ip_address = 192.168.122.227 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] target_port = 3260 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] target_protocol = iscsi {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] target_secondary_ip_addresses = [] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] trace_flags = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] transport_url = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] until_refresh = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] use_chap_auth = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] use_default_quota_class = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] use_journal = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] use_json = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] use_multipath_for_image_xfer = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] use_stderr = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] use_syslog = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] verify_glance_signatures = enabled {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volume_api_class = cinder.volume.api.API {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volume_backend_name = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volume_clear = zero {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volume_clear_ionice = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volume_clear_size = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volume_copy_bps_limit = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volume_dd_blocksize = 1M {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volume_name_template = volume-%s {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volume_service_inithost_offload = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volume_usage_audit_period = month {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] zoning_mode = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_concurrency.disable_process_locking = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.admin_password = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.admin_token = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.admin_user = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.auth_admin_prefix = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.auth_port = 35357 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.auth_protocol = https {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.auth_section = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.auth_type = password {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.auth_uri = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.auth_version = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.cache = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.certfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.identity_uri = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.include_service_catalog = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.insecure = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.interface = public {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.keyfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_password = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcache_username = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.region_name = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.service_token_roles_required = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.service_type = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.227/identity {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.backend = dogpile.cache.null {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.backend_argument = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.backend_expiration_time = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.config_prefix = cache.oslo {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.debug_cache_backend = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.enable_retry_client = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.enable_socket_keepalive = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.enabled = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.enforce_fips_mode = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.expiration_time = 600 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.hashclient_retry_attempts = 2 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.memcache_dead_retry = 300 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.memcache_pool_maxsize = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.memcache_sasl_enabled = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.password = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.proxies = [] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.redis_db = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.redis_server = localhost:6379 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.retry_attempts = 2 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.retry_delay = 0.0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.socket_keepalive_count = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.socket_keepalive_idle = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.socket_keepalive_interval = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.socket_timeout = 1.0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.tls_allowed_ciphers = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.tls_cafile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.tls_certfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.tls_enabled = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.tls_keyfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cache.username = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.asyncio_connection = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.asyncio_slave_connection = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.backend = sqlalchemy {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.connection = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.connection_debug = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.connection_parameters = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.connection_recycle_time = 3600 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.connection_trace = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.db_inc_retry_interval = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.db_max_retries = 20 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.db_max_retry_interval = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.db_retry_interval = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.max_overflow = 50 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.max_pool_size = 5 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.max_retries = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.mysql_wsrep_sync_wait = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.pool_timeout = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.retry_interval = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.slave_connection = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.sqlite_synchronous = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.synchronous_reader = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] database.use_db_reconnect = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler.connection_string = messaging:// {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler.enabled = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler.es_doc_type = notification {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler.es_scroll_size = 10000 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler.es_scroll_time = 2m {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler.filter_error_trace = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler.hmac_keys = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler.sentinel_service_name = mymaster {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler.socket_timeout = 0.1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler.trace_requests = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler.trace_sqlalchemy = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86722) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 04 13:14:37 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.quobyte [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler_jaeger.process_tags = {} {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler_jaeger.service_name_prefix = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] profiler_otlp.service_name_prefix = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_policy.enforce_new_defaults = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.quobyte [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 04 13:14:37 devstack cinder-volume[86477]: WARNING oslo_config.cfg [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_policy.enforce_scope = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_policy.policy_default_rule = default {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Running cmd (subprocess): mount.quobyte {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_policy.policy_file = policy.yaml {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] coordination.backend_url = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] privsep_osbrick.group = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] privsep_osbrick.helper_command = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] privsep_osbrick.user = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cinder_sys_admin.group = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cinder_sys_admin.helper_command = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] cinder_sys_admin.user = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] service_user.auth_section = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] service_user.auth_type = password {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] service_user.cafile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] service_user.certfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] service_user.collect_timing = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] service_user.insecure = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] service_user.keyfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] service_user.send_service_user_token = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] service_user.split_loggers = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] service_user.timeout = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance.auth_section = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance.auth_type = password {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance.certfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance.collect_timing = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance.insecure = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance.keyfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance.region_name = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance.split_loggers = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] glance.timeout = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.backend_availability_zone = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.chap_password = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.chap_username = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.disk_geometry = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.driver_client_cert = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.driver_client_cert_key = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.driver_data_namespace = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.driver_use_ssl = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.extra_capabilities = {} {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.filter_function = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.goodness_function = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.iscsi_target_flags = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.iscsi_write_cache = on {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.iser_helper = tgtadm {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.iser_ip_address = 192.168.122.227 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.iser_port = 3260 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nas_host = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nas_login = admin {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nas_mount_options = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nas_password = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nas_private_key = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nas_share_path = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.num_shell_tries = 3 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.quobyte_volume_url = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.replication_device = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.report_discard_supported = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.reserved_percentage = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.target_helper = tgtadm {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.target_ip_address = 192.168.122.227 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.target_port = 3260 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.target_protocol = iscsi {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.trace_flags = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.unique_fqdn_network = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.use_chap_auth = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.volume_backend_name = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.volume_clear = zero {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.volume_clear_ionice = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.volume_clear_size = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_reports.file_event_handler = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_reports.log_dir = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.backend_availability_zone = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.backend_host = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.chap_password = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.chap_username = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.chiscsi_conf = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.disk_geometry = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.driver_client_cert = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.driver_data_namespace = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.driver_use_ssl = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.extra_capabilities = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.filter_function = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.goodness_function = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.iser_helper = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.iser_ip_address = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.iser_port = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.iser_target_prefix = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nas_host = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nas_login = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nas_mount_options = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nas_password = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nas_private_key = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nas_share_path = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nas_ssh_port = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.num_shell_tries = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.nvmet_port_id = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.replication_device = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.report_discard_supported = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.reserved_percentage = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.scst_target_driver = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.storage_protocol = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.target_helper = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.target_ip_address = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.target_port = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.target_prefix = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.target_protocol = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.trace_flags = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.use_chap_auth = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.volume_clear = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.volume_clear_size = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack quobyte-client[86729]: Reading configuration file: /etc/quobyte/client.cfg Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] QuobyteHD.volumes_dir = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack quobyte-client[86729]: Invalid parameters found, error: missing mount point. Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack quobyte-client[86729]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack quobyte-client[86729]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 04 13:14:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.ssl = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_notifications.driver = [] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_notifications.retry = -1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] key_manager.fixed_key = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.barbican_api_version = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.barbican_endpoint = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.barbican_endpoint_type = public {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.barbican_region_name = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.cafile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.certfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.collect_timing = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.insecure = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.keyfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.number_of_retries = 60 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.retry_delay = 1 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.send_service_user_token = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.split_loggers = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.timeout = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.verify_ssl = True {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican.verify_ssl_path = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican_service_user.auth_section = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican_service_user.auth_type = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican_service_user.cafile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican_service_user.certfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican_service_user.collect_timing = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican_service_user.insecure = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican_service_user.keyfile = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican_service_user.split_loggers = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] barbican_service_user.timeout = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] vault.approle_role_id = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] vault.approle_secret_id = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] vault.kv_mountpoint = secret {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] vault.kv_path = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] vault.kv_version = 2 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] vault.namespace = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] vault.root_token_id = **** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] vault.ssl_ca_crt_file = None {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] vault.timeout = 60.0 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] vault.use_ssl = False {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 04 13:14:37 devstack cinder-volume[86477]: DEBUG oslo_service.backend._eventlet.service [None req-2e875caa-d8da-4287-acf6-6bafa7cbc86b None None] ******************************************************************************** {{(pid=86477) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 04 13:14:37 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:14:37 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:14:38 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Jun 04 13:14:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.614s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:14:38 devstack cinder-volume[86722]: INFO cinder.volume.driver [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Driver hasn't implemented _init_vendor_properties() Jun 04 13:14:38 devstack cinder-volume[86722]: DEBUG cinder.volume.driver [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579879760742, 'free_capacity_gb': 1775.7579879760742, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86722) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 04 13:14:38 devstack cinder-volume[86722]: DEBUG oslo_db.sqlalchemy.engines [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 04 13:14:38 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writer thread running {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 04 13:14:38 devstack cinder-volume[86722]: DEBUG cinder.db.sqlalchemy.api [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Building query based on filter {{(pid=86722) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3944}} Jun 04 13:14:38 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86722) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 04 13:14:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:14:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:14:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:14:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:14:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:14:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:14:38 devstack cinder-volume[86722]: INFO cinder.keymgr.migration [None req-4551c436-d438-4243-b4ba-2fdcc1f14cd8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 04 13:14:38 devstack sudo[86744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:14:38 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:14:39 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root Jun 04 13:14:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.585s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:14:39 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:14:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Driver initialization completed successfully. Jun 04 13:14:39 devstack cinder-volume[86722]: INFO cinder.manager [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Initiating service 3 cleanup Jun 04 13:14:39 devstack cinder-volume[86722]: INFO cinder.manager [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Service 3 cleanup completed. Jun 04 13:14:39 devstack cinder-volume[86722]: DEBUG cinder.service [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Creating RPC server for service cinder-volume {{(pid=86722) start /opt/stack/cinder/cinder/service.py:231}} Jun 04 13:14:39 devstack cinder-volume[86722]: DEBUG cinder.service [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86722) start /opt/stack/cinder/cinder/service.py:237}} Jun 04 13:14:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 04 13:14:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:14:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:14:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:14:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:14:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:14:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:14:39 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:14:39 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:14:39 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Jun 04 13:14:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.591s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:14:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-50e03372-db5d-4975-8c54-5288d67f18d8 None None] Driver post RPC initialization completed successfully. Jun 04 13:14:47 devstack cinder-volume[86477]: DEBUG dbcounter [-] [86477] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86477) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:14:49 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=2 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:14:49 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:15:03 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:15:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 6 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:15:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Flow 'volume_create_manager' (bace8d40-7562-42f9-a6ef-9e150a1f3a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616116bc-0ab1-4f25-be80-e9ad42329ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616116bc-0ab1-4f25-be80-e9ad42329ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1929023789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8422519-6ce9-4ac6-8dcc-01e50139a82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4c2588ebab445f84201920c21d62c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:15:59Z,use_quota=True,user_id='1f28b4faf2a341ae8ba382baa729f430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144c8292-fb43-49a1-a853-ebab5703caed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144c8292-fb43-49a1-a853-ebab5703caed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6fd489-be38-415e-a048-874662eda83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6fd489-be38-415e-a048-874662eda83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8422519-6ce9-4ac6-8dcc-01e50139a82c', 'volume_name': 'volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4e5a4f-3679-44f7-a54b-3898485bd5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4e5a4f-3679-44f7-a54b-3898485bd5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b634ac7d-3356-4b74-9e6a-8ea1354e93ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:15:59 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Volume e8422519-6ce9-4ac6-8dcc-01e50139a82c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c', 'volume_size': 1} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1929023789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8422519-6ce9-4ac6-8dcc-01e50139a82c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b4c2588ebab445f84201920c21d62c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:15:59Z,use_quota=True,user_id='1f28b4faf2a341ae8ba382baa729f430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Creating volume e8422519-6ce9-4ac6-8dcc-01e50139a82c {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:15:59 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:15:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:15:59 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c 1073741824 Jun 04 13:15:59 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:00 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:16:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Flow 'volume_create_manager' (007ae5ff-1427-4a5b-8ddc-3cae4b168dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:16:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c42350c-d5e6-4872-a79a-5477ae046e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c42350c-d5e6-4872-a79a-5477ae046e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1757328503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9aa134b-0149-4e60-afea-6c1fc4d43a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e684fb55ff4a4279a2da05bd26a074b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:16:00Z,use_quota=True,user_id='42bb5211a1874c4580472f081488b3f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40984ad0-cc01-4aa9-a4e6-92b4a27b99c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40984ad0-cc01-4aa9-a4e6-92b4a27b99c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3052d9bd-0f54-466d-93e9-2dcde0a72ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3052d9bd-0f54-466d-93e9-2dcde0a72ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9aa134b-0149-4e60-afea-6c1fc4d43a29', 'volume_name': 'volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c664346c-e453-4187-bdac-3cc631d51c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c664346c-e453-4187-bdac-3cc631d51c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c20945-d469-46b3-8175-3ed9f5cb717b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:00 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Volume c9aa134b-0149-4e60-afea-6c1fc4d43a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29', 'volume_size': 1} Jun 04 13:16:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:16:01 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c 1073741824" returned: 0 in 1.456s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:01 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c Jun 04 13:16:01 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:02 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c" returned: 0 in 1.086s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] <== create_volume: return (2670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.677s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.946s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1757328503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9aa134b-0149-4e60-afea-6c1fc4d43a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e684fb55ff4a4279a2da05bd26a074b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:16:00Z,use_quota=True,user_id='42bb5211a1874c4580472f081488b3f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Creating volume c9aa134b-0149-4e60-afea-6c1fc4d43a29 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:16:02 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b634ac7d-3356-4b74-9e6a-8ea1354e93ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48373dc4-c658-40df-b07a-96a51bfe02d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:02 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29 1073741824 Jun 04 13:16:02 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:02 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Volume volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c (e8422519-6ce9-4ac6-8dcc-01e50139a82c): created successfully Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48373dc4-c658-40df-b07a-96a51bfe02d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Flow 'volume_create_manager' (bace8d40-7562-42f9-a6ef-9e150a1f3a84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:16:02 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b68a5c16-5191-46f2-9c85-05330c212efc tempest-DeleteServersTestJSON-679114291 None] Created volume successfully. Jun 04 13:16:03 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29 1073741824" returned: 0 in 1.438s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:03 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29 Jun 04 13:16:03 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:03 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:16:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:16:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:16:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:16:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:16:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:16:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:04 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:16:04 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:05 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.573s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:05 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:16:05 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:16:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 6 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:16:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:16:05 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29" returned: 0 in 1.916s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] <== create_volume: return (3438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:16:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.444s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:16:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c20945-d469-46b3-8175-3ed9f5cb717b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f5e0e47-efa7-4879-9735-fdc42b98171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:05 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Volume volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29 (c9aa134b-0149-4e60-afea-6c1fc4d43a29): created successfully Jun 04 13:16:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f5e0e47-efa7-4879-9735-fdc42b98171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Flow 'volume_create_manager' (007ae5ff-1427-4a5b-8ddc-3cae4b168dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:16:05 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-cb160611-7fdb-4ece-9f8e-f61a01752b6d tempest-VolumesAdminNegativeTest-2032812725 None] Created volume successfully. Jun 04 13:16:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Acquiring lock "cinder-c9aa134b-0149-4e60-afea-6c1fc4d43a29-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:16:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Lock "cinder-c9aa134b-0149-4e60-afea-6c1fc4d43a29-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:16:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Acquiring lock "cinder-quobyte-c9aa134b-0149-4e60-afea-6c1fc4d43a29" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:16:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Lock "cinder-quobyte-c9aa134b-0149-4e60-afea-6c1fc4d43a29" acquired by "delete_volume" :: waited 0.040s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:16:07 devstack cinder-volume[86722]: INFO oslo.privsep.daemon [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp49x_nxe8/privsep.sock'] Jun 04 13:16:07 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp49x_nxe8/privsep.sock Jun 04 13:16:07 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:11 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:11 devstack cinder-volume[86722]: INFO oslo.privsep.daemon [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Spawned new privsep daemon via rootwrap Jun 04 13:16:11 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Accepted privsep connection to /tmp/tmp49x_nxe8/privsep.sock {{(pid=86722) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 04 13:16:11 devstack cinder-volume[86722]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 04 13:16:11 devstack cinder-volume[86722]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 04 13:16:11 devstack cinder-volume[86722]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 04 13:16:11 devstack cinder-volume[86722]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87568 Jun 04 13:16:11 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe52ccf-102d-4da7-a0dc-1373423478bc]: (2,) {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:16:11 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee9a04e-775c-4db6-9c29-79491b616d7b]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:16:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:11 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29 Jun 04 13:16:11 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:12 devstack cinder-volume[86722]: WARNING py.warnings [req-41082f78-31e5-47a8-bedd-8457560b0cae req-abfecad5-ed68-4044-bddc-d28051379b41 tempest-DeleteServersTestJSON-679114291 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jun 04 13:16:12 devstack cinder-volume[86722]: .first() Jun 04 13:16:12 devstack cinder-volume[86722]: Jun 04 13:16:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-41082f78-31e5-47a8-bedd-8457560b0cae req-abfecad5-ed68-4044-bddc-d28051379b41 tempest-DeleteServersTestJSON-679114291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:16:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-41082f78-31e5-47a8-bedd-8457560b0cae req-abfecad5-ed68-4044-bddc-d28051379b41 tempest-DeleteServersTestJSON-679114291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:16:12 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[182092d0-16cf-4413-9aa5-2e6c1ea7a009]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:16:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-41082f78-31e5-47a8-bedd-8457560b0cae req-abfecad5-ed68-4044-bddc-d28051379b41 tempest-DeleteServersTestJSON-679114291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:12 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29" returned: 0 in 1.406s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:12 devstack sudo[87588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29 Jun 04 13:16:12 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:12 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c Jun 04 13:16:12 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:14 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c9aa134b-0149-4e60-afea-6c1fc4d43a29" returned: 0 in 1.685s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Lock "cinder-quobyte-c9aa134b-0149-4e60-afea-6c1fc4d43a29" released by "delete_volume" :: held 6.712s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:16:14 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-41082f78-31e5-47a8-bedd-8457560b0cae req-abfecad5-ed68-4044-bddc-d28051379b41 tempest-DeleteServersTestJSON-679114291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c" returned: 0 in 1.984s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-41082f78-31e5-47a8-bedd-8457560b0cae req-abfecad5-ed68-4044-bddc-d28051379b41 tempest-DeleteServersTestJSON-679114291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.026s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:16:14 devstack cinder-volume[86722]: WARNING cinder.quota [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:16:14 devstack cinder-volume[86722]: WARNING cinder.quota [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:16:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-41082f78-31e5-47a8-bedd-8457560b0cae req-abfecad5-ed68-4044-bddc-d28051379b41 tempest-DeleteServersTestJSON-679114291 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16c5b2d9-22b3-4e0d-a83f-a54febd06207', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:16:14 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Created reservations ['4fc7f21a-bc0f-4614-8c45-df46516d3adb', 'd417ebd8-82ac-43f1-a7e8-56e9a39b2adc', '649268e8-fd30-4361-8b94-eb7ea9ed763b', 'a6e50f46-8a33-4486-9db3-76c5b9e94021'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:16:15 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-41082f78-31e5-47a8-bedd-8457560b0cae req-abfecad5-ed68-4044-bddc-d28051379b41 tempest-DeleteServersTestJSON-679114291 None] attachment_update completed successfully. Jun 04 13:16:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:16:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:16:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:16:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:16:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:16:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:15 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:16:15 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:16 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.353s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:16 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:16:16 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Deleted volume successfully. Jun 04 13:16:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dda4c236-3ace-42a7-855a-45e4b87d488e tempest-VolumesAdminNegativeTest-2032812725 None] Lock "cinder-c9aa134b-0149-4e60-afea-6c1fc4d43a29-delete_volume" released by "delete_volume" :: held 8.856s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:16:25 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=16,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:16:25 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-3bdb5250-ff41-43ac-90bf-769b8e14e87c req-fef8b387-70d0-4ac0-9ae2-f6cb017f03d4 tempest-DeleteServersTestJSON-679114291 None] Terminate volume connection completed successfully. Jun 04 13:16:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-3bdb5250-ff41-43ac-90bf-769b8e14e87c req-fef8b387-70d0-4ac0-9ae2-f6cb017f03d4 tempest-DeleteServersTestJSON-679114291 None] Deleting attachment 16c5b2d9-22b3-4e0d-a83f-a54febd06207. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:16:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Acquiring lock "cinder-e8422519-6ce9-4ac6-8dcc-01e50139a82c-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:16:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Lock "cinder-e8422519-6ce9-4ac6-8dcc-01e50139a82c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:16:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Acquiring lock "cinder-quobyte-e8422519-6ce9-4ac6-8dcc-01e50139a82c" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:16:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Lock "cinder-quobyte-e8422519-6ce9-4ac6-8dcc-01e50139a82c" acquired by "delete_volume" :: waited 0.043s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:16:30 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faa1e15-b299-4f15-9d7b-754246332a37]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:16:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:30 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c Jun 04 13:16:30 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:30 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c" returned: 0 in 0.912s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:30 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c Jun 04 13:16:30 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:31 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e8422519-6ce9-4ac6-8dcc-01e50139a82c" returned: 0 in 0.783s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:31 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Lock "cinder-quobyte-e8422519-6ce9-4ac6-8dcc-01e50139a82c" released by "delete_volume" :: held 1.789s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:16:31 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Created reservations ['51663059-9801-4c87-adb5-b12d4776c04a', 'f0d140f1-196b-467a-a5d0-9f95ff4bc306', 'dff55302-dcfc-47d0-a37f-3cb435d8bc78', 'd21bf36d-540f-4341-b253-58c818f5a18b'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:16:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:16:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:16:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:16:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:16:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:16:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:32 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:16:32 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:32 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.702s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:32 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:16:32 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Deleted volume successfully. Jun 04 13:16:32 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-04b73e6c-0437-403d-9770-59b6989c9fc9 tempest-DeleteServersTestJSON-679114291 None] Lock "cinder-e8422519-6ce9-4ac6-8dcc-01e50139a82c-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Flow 'volume_create_manager' (d87a91f6-9160-4e60-96d9-263e70eca30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e185751-9bb3-4a65-9337-02c9f70c2d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e185751-9bb3-4a65-9337-02c9f70c2d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-158891317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ed87bd-18d0-4f77-8c31-54a8b853ad47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe6dde82b324c998230fcdc04782035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:16:33Z,use_quota=True,user_id='3c619817639f4f10973787fa4fb7c727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334018a1-aed3-4111-891c-4e72e7487c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334018a1-aed3-4111-891c-4e72e7487c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e45f56-ea55-41d2-8eea-481ed0d8608b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e45f56-ea55-41d2-8eea-481ed0d8608b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ed87bd-18d0-4f77-8c31-54a8b853ad47', 'volume_name': 'volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f80cf92-aded-4bf1-b65d-ad198724d778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f80cf92-aded-4bf1-b65d-ad198724d778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7179e1b-c532-4677-92ff-5fb49b912c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:33 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Volume 36ed87bd-18d0-4f77-8c31-54a8b853ad47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47', 'volume_size': 1} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-158891317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ed87bd-18d0-4f77-8c31-54a8b853ad47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe6dde82b324c998230fcdc04782035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:16:33Z,use_quota=True,user_id='3c619817639f4f10973787fa4fb7c727',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Creating volume 36ed87bd-18d0-4f77-8c31-54a8b853ad47 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:16:33 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:16:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:33 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47 1073741824 Jun 04 13:16:33 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:34 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47 1073741824" returned: 0 in 0.914s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:34 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47 Jun 04 13:16:34 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:35 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47" returned: 0 in 0.704s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:16:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:16:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7179e1b-c532-4677-92ff-5fb49b912c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48779c7-1483-4558-9070-6f5c2904d665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:35 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Volume volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47 (36ed87bd-18d0-4f77-8c31-54a8b853ad47): created successfully Jun 04 13:16:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48779c7-1483-4558-9070-6f5c2904d665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Flow 'volume_create_manager' (d87a91f6-9160-4e60-96d9-263e70eca30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:16:35 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-35563f93-4588-473b-b6b0-24e23320f80b tempest-TaggedAttachmentsTest-1801617307 None] Created volume successfully. Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Flow 'volume_create_manager' (9248319c-b576-4079-8d4d-1fafc31347a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0e0964-f12d-4487-9e97-6758eecd06a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0e0964-f12d-4487-9e97-6758eecd06a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-57967348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12561b5-bfbf-43d1-ba4c-acce7bad794b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b0999794184d07ac59799e355025d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:16:41Z,use_quota=True,user_id='ea3f0c5cc62b44bb84cac7e774f767ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae265c6c-b159-44b0-b06e-a5665a5fe035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae265c6c-b159-44b0-b06e-a5665a5fe035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d57faba-7018-4a7d-969f-0032eb74b0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d57faba-7018-4a7d-969f-0032eb74b0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c12561b5-bfbf-43d1-ba4c-acce7bad794b', 'volume_name': 'volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f829316-fe8e-4868-b781-494b87077c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f829316-fe8e-4868-b781-494b87077c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479f49fc-a758-43f9-93df-fff59124754e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:40 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Volume c12561b5-bfbf-43d1-ba4c-acce7bad794b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b', 'volume_size': 1} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-57967348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12561b5-bfbf-43d1-ba4c-acce7bad794b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94b0999794184d07ac59799e355025d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:16:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:16:41Z,use_quota=True,user_id='ea3f0c5cc62b44bb84cac7e774f767ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Creating volume c12561b5-bfbf-43d1-ba4c-acce7bad794b {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:16:40 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:16:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:40 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b 1073741824 Jun 04 13:16:40 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:41 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b 1073741824" returned: 0 in 0.975s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:16:41 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b Jun 04 13:16:41 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:16:42 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Jun 04 13:16:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b" returned: 0 in 0.701s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:16:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:16:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:16:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479f49fc-a758-43f9-93df-fff59124754e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafabdf0-bd45-48d8-b969-fe9586e41b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:16:42 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Volume volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b (c12561b5-bfbf-43d1-ba4c-acce7bad794b): created successfully Jun 04 13:16:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafabdf0-bd45-48d8-b969-fe9586e41b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:16:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Flow 'volume_create_manager' (9248319c-b576-4079-8d4d-1fafc31347a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:16:42 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-7848a35b-49b3-472b-89d5-1cbf3d2a8ec1 tempest-ServerActionsTestOtherA-886526931 None] Created volume successfully. Jun 04 13:16:52 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:16:52 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=33,cinder:SELECT=22,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:17:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:17:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:17:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:17:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:17:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:17:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:17:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:17:04 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:17:04 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:17:05 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Jun 04 13:17:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.256s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:17:05 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:17:05 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:17:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 8 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:17:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Flow 'volume_create_manager' (d8dc0f78-a5c1-4052-a027-ac2466f9b32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002b66a8-e073-4f36-bab0-a7b6a3b10902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002b66a8-e073-4f36-bab0-a7b6a3b10902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2133733768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b5e14a8e34407a8617b1f8f9550db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:17:46Z,use_quota=True,user_id='b93eb32751c844e6bea965b4b96d4807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ac14a0-a0d0-4cf7-8df6-b86fa59611e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ac14a0-a0d0-4cf7-8df6-b86fa59611e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43dd402-4ad0-4b35-b28a-5cc2bbe1c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43dd402-4ad0-4b35-b28a-5cc2bbe1c837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1', 'volume_name': 'volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd89d7b-a191-4b3d-8793-23c1f29d521b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd89d7b-a191-4b3d-8793-23c1f29d521b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bb26f3-0b44-416c-9929-a0d8723be949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:17:46 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Volume dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1', 'volume_size': 1} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2133733768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b5e14a8e34407a8617b1f8f9550db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:17:46Z,use_quota=True,user_id='b93eb32751c844e6bea965b4b96d4807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Creating volume dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:17:46 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:17:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:17:46 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1 1073741824 Jun 04 13:17:46 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:17:47 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Jun 04 13:17:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1 1073741824" returned: 0 in 0.760s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:17:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:17:47 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1 Jun 04 13:17:47 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:17:47 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Jun 04 13:17:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1" returned: 0 in 0.602s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:17:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:17:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:17:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bb26f3-0b44-416c-9929-a0d8723be949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:17:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21b40d8-7ff1-4bba-83a9-abc7126c0c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:17:47 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Volume volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1 (dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1): created successfully Jun 04 13:17:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21b40d8-7ff1-4bba-83a9-abc7126c0c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:17:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Flow 'volume_create_manager' (d8dc0f78-a5c1-4052-a027-ac2466f9b32e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:17:47 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-265c6151-4d5b-48fc-98c5-4cb65e1253f0 tempest-ServersNegativeTestJSON-1903110252 None] Created volume successfully. Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Flow 'volume_create_manager' (128f38b3-441a-4e2d-93ab-6d52052b4dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584cab43-0d4f-4704-b8db-1030d296a0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584cab43-0d4f-4704-b8db-1030d296a0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-400750869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b5e14a8e34407a8617b1f8f9550db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:17:50Z,use_quota=True,user_id='b93eb32751c844e6bea965b4b96d4807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96332b3c-6d8f-4e8b-b6cb-da5086ee64a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96332b3c-6d8f-4e8b-b6cb-da5086ee64a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c648d6a-c523-42d7-8b4d-dfc10c20f08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c648d6a-c523-42d7-8b4d-dfc10c20f08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087', 'volume_name': 'volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe5ea98-42d9-420b-935b-cdd685d66abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe5ea98-42d9-420b-935b-cdd685d66abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25cc67c2-7b15-4c51-aa7a-20394df64dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:17:49 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Volume 7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087', 'volume_size': 1} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-400750869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b5e14a8e34407a8617b1f8f9550db7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:17:50Z,use_quota=True,user_id='b93eb32751c844e6bea965b4b96d4807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Creating volume 7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:17:49 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:17:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:17:49 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087 1073741824 Jun 04 13:17:49 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:17:50 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Jun 04 13:17:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087 1073741824" returned: 0 in 0.796s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:17:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:17:50 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087 Jun 04 13:17:50 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:17:51 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Jun 04 13:17:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087" returned: 0 in 0.596s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:17:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:17:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:17:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25cc67c2-7b15-4c51-aa7a-20394df64dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:17:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03858d6-c206-47d3-9622-ab597b1e9122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:17:51 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Volume volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087 (7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087): created successfully Jun 04 13:17:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03858d6-c206-47d3-9622-ab597b1e9122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:17:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Flow 'volume_create_manager' (128f38b3-441a-4e2d-93ab-6d52052b4dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:17:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-718f8f17-4991-4276-9f45-ac2a08038d3c tempest-ServersNegativeTestJSON-1903110252 None] Created volume successfully. Jun 04 13:17:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Acquiring lock "cinder-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:17:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Lock "cinder-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:17:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Acquiring lock "cinder-quobyte-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:17:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Lock "cinder-quobyte-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087" acquired by "delete_volume" :: waited 0.013s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:17:52 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a95ead1-d087-4cda-8322-2f7de89095c3]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:17:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:17:52 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087 Jun 04 13:17:52 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:17:52 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Jun 04 13:17:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087" returned: 0 in 0.689s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:17:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:17:52 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087 Jun 04 13:17:52 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:17:53 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Jun 04 13:17:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087" returned: 0 in 0.581s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:17:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Lock "cinder-quobyte-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087" released by "delete_volume" :: held 1.312s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:17:53 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Created reservations ['c526f348-1edd-4afd-8dcb-4bf4ade657ae', 'de50251a-c006-4a5c-98b8-883a18e5e56f', '551e5236-0ba0-480a-80f0-536f23e54a7d', '0d1da525-fdee-41fb-bd41-6f18eab93da9'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:17:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:17:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:17:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:17:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:17:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:17:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:17:53 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:17:53 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:17:54 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Jun 04 13:17:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.603s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:17:54 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:17:54 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Deleted volume successfully. Jun 04 13:17:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e45f2633-8b73-41d9-acfa-51576529a536 tempest-ServersNegativeTestJSON-1903110252 None] Lock "cinder-7e1f88f5-d5bd-492b-a0c0-b9c5c79d3087-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:17:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Acquiring lock "cinder-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:17:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Lock "cinder-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:17:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Acquiring lock "cinder-quobyte-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:17:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Lock "cinder-quobyte-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1" acquired by "delete_volume" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:17:54 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[233c0854-7635-47ea-82a5-1d539fc4ef3f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:17:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:17:54 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1 Jun 04 13:17:54 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:17:55 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Jun 04 13:17:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1" returned: 0 in 0.703s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:17:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:17:55 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1 Jun 04 13:17:55 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:17:55 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Jun 04 13:17:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1" returned: 0 in 0.596s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:17:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Lock "cinder-quobyte-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1" released by "delete_volume" :: held 1.342s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:17:55 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Created reservations ['8231fbb7-6927-476a-8e22-e9ca807e5a4c', 'b6097ab9-f34d-425f-8b8d-4908d46c2f19', 'cf8e5571-1106-4abc-b7e1-1820db253b68', '8805955e-aa7a-4c63-b759-a00be495ab63'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:17:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:17:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:17:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:17:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:17:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:17:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:17:55 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:17:55 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:17:56 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Jun 04 13:17:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.688s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:17:56 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:17:56 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Deleted volume successfully. Jun 04 13:17:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e5bed17c-47ff-44f4-9396-3da929862790 tempest-ServersNegativeTestJSON-1903110252 None] Lock "cinder-dee84ee4-90e5-4f07-bfc8-ab7eb2688aa1-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:17:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-1aeaa018-937d-400b-a53f-27ace986d9b8 req-405785b8-724a-4619-a67f-170d360248dd tempest-ServerActionsTestOtherA-886526931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:17:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-1aeaa018-937d-400b-a53f-27ace986d9b8 req-405785b8-724a-4619-a67f-170d360248dd tempest-ServerActionsTestOtherA-886526931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:17:59 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ba8beb-8d9f-4028-a6bf-1a5f756103af]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:17:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1aeaa018-937d-400b-a53f-27ace986d9b8 req-405785b8-724a-4619-a67f-170d360248dd tempest-ServerActionsTestOtherA-886526931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:00 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b Jun 04 13:18:00 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:00 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1aeaa018-937d-400b-a53f-27ace986d9b8 req-405785b8-724a-4619-a67f-170d360248dd tempest-ServerActionsTestOtherA-886526931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b" returned: 0 in 1.102s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-1aeaa018-937d-400b-a53f-27ace986d9b8 req-405785b8-724a-4619-a67f-170d360248dd tempest-ServerActionsTestOtherA-886526931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.131s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-1aeaa018-937d-400b-a53f-27ace986d9b8 req-405785b8-724a-4619-a67f-170d360248dd tempest-ServerActionsTestOtherA-886526931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3b366d1-8d29-4dbf-b4ba-3c4c03a18a0a', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:18:01 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-1aeaa018-937d-400b-a53f-27ace986d9b8 req-405785b8-724a-4619-a67f-170d360248dd tempest-ServerActionsTestOtherA-886526931 None] attachment_update completed successfully. Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Flow 'volume_create_manager' (b25726a2-8138-4ab8-93e9-ca3780374516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee8e525-7eab-4e0c-a01f-8a21c52e6d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee8e525-7eab-4e0c-a01f-8a21c52e6d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-617139842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5a4b80-64dc-4310-bb63-65a2b2667836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88233746d6e94b17927083d67c47fd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:18:01Z,use_quota=True,user_id='307b875628814a968259145eb7157b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765ac00e-8d0e-4519-b5ad-793f00538c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (765ac00e-8d0e-4519-b5ad-793f00538c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d358c6bd-7f96-46e6-8281-62704ab09f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d358c6bd-7f96-46e6-8281-62704ab09f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c5a4b80-64dc-4310-bb63-65a2b2667836', 'volume_name': 'volume-7c5a4b80-64dc-4310-bb63-65a2b2667836', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64c1d5a-bccf-40fb-926a-8b4ef71d0aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64c1d5a-bccf-40fb-926a-8b4ef71d0aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb21946a-839e-4181-9f57-a5e3367bf1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:18:01 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Volume 7c5a4b80-64dc-4310-bb63-65a2b2667836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c5a4b80-64dc-4310-bb63-65a2b2667836', 'volume_size': 1} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-617139842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5a4b80-64dc-4310-bb63-65a2b2667836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88233746d6e94b17927083d67c47fd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:18:01Z,use_quota=True,user_id='307b875628814a968259145eb7157b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Creating volume 7c5a4b80-64dc-4310-bb63-65a2b2667836 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:18:01 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:18:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:01 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836 1073741824 Jun 04 13:18:01 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:02 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836 1073741824" returned: 0 in 0.941s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:02 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836 Jun 04 13:18:02 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:03 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836" returned: 0 in 0.628s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:18:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:18:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb21946a-839e-4181-9f57-a5e3367bf1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c5a4b80-64dc-4310-bb63-65a2b2667836', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:18:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8228e7-e732-4c17-aa89-b889aac1e57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:18:03 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Volume volume-7c5a4b80-64dc-4310-bb63-65a2b2667836 (7c5a4b80-64dc-4310-bb63-65a2b2667836): created successfully Jun 04 13:18:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8228e7-e732-4c17-aa89-b889aac1e57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:18:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Flow 'volume_create_manager' (b25726a2-8138-4ab8-93e9-ca3780374516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:18:03 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-cef65759-b80c-4167-93f5-f26436883e34 tempest-AttachVolumeTestJSON-1108399174 None] Created volume successfully. Jun 04 13:18:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:18:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:18:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:18:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:18:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:18:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:18:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:04 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:18:04 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:04 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.593s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:18:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-4295a10e-19d9-4d62-b571-574ac7d06df3 req-e538b582-a70b-4e5b-998f-2eaf225d7b11 tempest-TaggedAttachmentsTest-1801617307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:18:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-4295a10e-19d9-4d62-b571-574ac7d06df3 req-e538b582-a70b-4e5b-998f-2eaf225d7b11 tempest-TaggedAttachmentsTest-1801617307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:18:06 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfc51f7-1d7b-491c-8640-7f2d38160558]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:18:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-4295a10e-19d9-4d62-b571-574ac7d06df3 req-e538b582-a70b-4e5b-998f-2eaf225d7b11 tempest-TaggedAttachmentsTest-1801617307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:06 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47 Jun 04 13:18:06 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a1f9eca4-c052-4c04-9a84-616ebe98aef4 req-82edd62a-7ba9-4f5b-b32c-e76bf31a9869 tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:18:07 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-4295a10e-19d9-4d62-b571-574ac7d06df3 req-e538b582-a70b-4e5b-998f-2eaf225d7b11 tempest-TaggedAttachmentsTest-1801617307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47" returned: 0 in 0.730s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-4295a10e-19d9-4d62-b571-574ac7d06df3 req-e538b582-a70b-4e5b-998f-2eaf225d7b11 tempest-TaggedAttachmentsTest-1801617307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.768s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:18:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a1f9eca4-c052-4c04-9a84-616ebe98aef4 req-82edd62a-7ba9-4f5b-b32c-e76bf31a9869 tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.595s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:18:07 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bf68b7-4866-4bf9-8580-03957e40c2ca]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:18:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a1f9eca4-c052-4c04-9a84-616ebe98aef4 req-82edd62a-7ba9-4f5b-b32c-e76bf31a9869 tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-4295a10e-19d9-4d62-b571-574ac7d06df3 req-e538b582-a70b-4e5b-998f-2eaf225d7b11 tempest-TaggedAttachmentsTest-1801617307 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42bfb7c5-5c94-4f14-916f-6798e0a17c31', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:18:07 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-4295a10e-19d9-4d62-b571-574ac7d06df3 req-e538b582-a70b-4e5b-998f-2eaf225d7b11 tempest-TaggedAttachmentsTest-1801617307 None] attachment_update completed successfully. Jun 04 13:18:07 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836 Jun 04 13:18:07 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:08 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a1f9eca4-c052-4c04-9a84-616ebe98aef4 req-82edd62a-7ba9-4f5b-b32c-e76bf31a9869 tempest-AttachVolumeTestJSON-1108399174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836" returned: 0 in 0.919s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a1f9eca4-c052-4c04-9a84-616ebe98aef4 req-82edd62a-7ba9-4f5b-b32c-e76bf31a9869 tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.940s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:18:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a1f9eca4-c052-4c04-9a84-616ebe98aef4 req-82edd62a-7ba9-4f5b-b32c-e76bf31a9869 tempest-AttachVolumeTestJSON-1108399174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-7c5a4b80-64dc-4310-bb63-65a2b2667836', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f614999-26f3-4c6c-89bb-0fd202bc1b26', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:18:08 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-a1f9eca4-c052-4c04-9a84-616ebe98aef4 req-82edd62a-7ba9-4f5b-b32c-e76bf31a9869 tempest-AttachVolumeTestJSON-1108399174 None] attachment_update completed successfully. Jun 04 13:18:10 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-7652d1c7-1bdb-494b-97d2-8429aacfba3d req-77c97458-c30c-4fd3-93aa-6552d4f86cf9 tempest-ServerActionsTestOtherA-886526931 None] Terminate volume connection completed successfully. Jun 04 13:18:10 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-7652d1c7-1bdb-494b-97d2-8429aacfba3d req-77c97458-c30c-4fd3-93aa-6552d4f86cf9 tempest-ServerActionsTestOtherA-886526931 None] Deleting attachment f3b366d1-8d29-4dbf-b4ba-3c4c03a18a0a. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:18:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-7652d1c7-1bdb-494b-97d2-8429aacfba3d req-0b4cce18-bb65-40cb-8f04-518ace14b933 tempest-ServerActionsTestOtherA-886526931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:18:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-7652d1c7-1bdb-494b-97d2-8429aacfba3d req-0b4cce18-bb65-40cb-8f04-518ace14b933 tempest-ServerActionsTestOtherA-886526931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:18:12 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c515c9-c54f-4e1e-b458-18bfa8e876fd]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:18:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-7652d1c7-1bdb-494b-97d2-8429aacfba3d req-0b4cce18-bb65-40cb-8f04-518ace14b933 tempest-ServerActionsTestOtherA-886526931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:12 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b Jun 04 13:18:12 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:13 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-7652d1c7-1bdb-494b-97d2-8429aacfba3d req-0b4cce18-bb65-40cb-8f04-518ace14b933 tempest-ServerActionsTestOtherA-886526931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b" returned: 0 in 0.796s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-7652d1c7-1bdb-494b-97d2-8429aacfba3d req-0b4cce18-bb65-40cb-8f04-518ace14b933 tempest-ServerActionsTestOtherA-886526931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.822s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:18:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-7652d1c7-1bdb-494b-97d2-8429aacfba3d req-0b4cce18-bb65-40cb-8f04-518ace14b933 tempest-ServerActionsTestOtherA-886526931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8835a4d9-1a19-4c3f-ad18-6d4a3380be63', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:18:13 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-7652d1c7-1bdb-494b-97d2-8429aacfba3d req-0b4cce18-bb65-40cb-8f04-518ace14b933 tempest-ServerActionsTestOtherA-886526931 None] attachment_update completed successfully. Jun 04 13:18:14 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-3896ed09-d32d-428a-9f8d-69c58e203a74 req-1d428000-062f-4635-9377-4c7fc32968a1 tempest-TaggedAttachmentsTest-1801617307 None] Terminate volume connection completed successfully. Jun 04 13:18:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-3896ed09-d32d-428a-9f8d-69c58e203a74 req-1d428000-062f-4635-9377-4c7fc32968a1 tempest-TaggedAttachmentsTest-1801617307 None] Deleting attachment 42bfb7c5-5c94-4f14-916f-6798e0a17c31. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:18:24 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=33,cinder:SELECT=40,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:18:24 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=40,cinder:UPDATE=29,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:18:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Acquiring lock "cinder-36ed87bd-18d0-4f77-8c31-54a8b853ad47-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:18:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Lock "cinder-36ed87bd-18d0-4f77-8c31-54a8b853ad47-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:18:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Acquiring lock "cinder-quobyte-36ed87bd-18d0-4f77-8c31-54a8b853ad47" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:18:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Lock "cinder-quobyte-36ed87bd-18d0-4f77-8c31-54a8b853ad47" acquired by "delete_volume" :: waited 0.028s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:18:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f2146c-36e3-4f2f-aab0-3951b7f94b7f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:18:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:37 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47 Jun 04 13:18:37 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:38 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47" returned: 0 in 0.756s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:38 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47 Jun 04 13:18:38 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:39 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-36ed87bd-18d0-4f77-8c31-54a8b853ad47" returned: 0 in 0.640s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Lock "cinder-quobyte-36ed87bd-18d0-4f77-8c31-54a8b853ad47" released by "delete_volume" :: held 1.450s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:18:39 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Created reservations ['80887654-3bd2-405b-8036-23076d414a9b', '5be5fefe-3775-49bc-beb2-0b39efaae599', 'd20a17fe-de2d-42f5-be6a-5f49e505d8d0', 'b04f2b86-c55c-4bf9-bdba-751f178c7024'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:18:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:18:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:18:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:18:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:18:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:18:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:39 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:18:39 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:40 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.621s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:40 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:18:40 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Deleted volume successfully. Jun 04 13:18:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf612992-9a81-4f9d-9602-62de81ae7162 tempest-TaggedAttachmentsTest-1801617307 None] Lock "cinder-36ed87bd-18d0-4f77-8c31-54a8b853ad47-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:18:48 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-54045054-fd0c-4ca7-9026-a73a6ad51978 req-a0b2be57-5d80-40ee-b2ee-46cf7b0f848b tempest-ServerActionsTestOtherA-886526931 None] Terminate volume connection completed successfully. Jun 04 13:18:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-54045054-fd0c-4ca7-9026-a73a6ad51978 req-a0b2be57-5d80-40ee-b2ee-46cf7b0f848b tempest-ServerActionsTestOtherA-886526931 None] Deleting attachment 8835a4d9-1a19-4c3f-ad18-6d4a3380be63. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:18:50 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=6,cinder:SELECT=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Flow 'volume_create_manager' (d6ab8f13-03af-43a1-828f-7f4403d83ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307bd4a0-224f-40ca-9085-66258d2cf447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307bd4a0-224f-40ca-9085-66258d2cf447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1405837517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe138a3-bfb2-4383-b918-22b258e65b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6ce944ea0a48fd9f9b81b0f49be457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:18:55Z,use_quota=True,user_id='03990eedc7dc450fbe7ce478d8970fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7446f4af-c231-4616-8e1f-b1a717f5e443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7446f4af-c231-4616-8e1f-b1a717f5e443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9594664-3966-4b20-b667-8ab2858ce584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9594664-3966-4b20-b667-8ab2858ce584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fe138a3-bfb2-4383-b918-22b258e65b42', 'volume_name': 'volume-6fe138a3-bfb2-4383-b918-22b258e65b42', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49a043c-b268-4281-a7e4-18a4d45fb1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49a043c-b268-4281-a7e4-18a4d45fb1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c94215-1bbb-420c-b644-7d191236717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:18:55 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Volume 6fe138a3-bfb2-4383-b918-22b258e65b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fe138a3-bfb2-4383-b918-22b258e65b42', 'volume_size': 1} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1405837517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe138a3-bfb2-4383-b918-22b258e65b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6ce944ea0a48fd9f9b81b0f49be457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:18:55Z,use_quota=True,user_id='03990eedc7dc450fbe7ce478d8970fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Creating volume 6fe138a3-bfb2-4383-b918-22b258e65b42 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:18:55 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:55 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 1073741824 Jun 04 13:18:55 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:55 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-d6971353-f403-483e-8a20-6c5015fe5b5d req-1439e00f-8266-4c38-abff-517d6e615455 tempest-AttachVolumeTestJSON-1108399174 None] Terminate volume connection completed successfully. Jun 04 13:18:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-d6971353-f403-483e-8a20-6c5015fe5b5d req-1439e00f-8266-4c38-abff-517d6e615455 tempest-AttachVolumeTestJSON-1108399174 None] Deleting attachment 3f614999-26f3-4c6c-89bb-0fd202bc1b26. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:18:56 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 1073741824" returned: 0 in 0.856s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:56 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 Jun 04 13:18:56 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:57 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42" returned: 0 in 0.578s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:18:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:18:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c94215-1bbb-420c-b644-7d191236717c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe138a3-bfb2-4383-b918-22b258e65b42', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:18:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b558f4-907d-404b-baeb-cbadd23c4f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:18:57 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Volume volume-6fe138a3-bfb2-4383-b918-22b258e65b42 (6fe138a3-bfb2-4383-b918-22b258e65b42): created successfully Jun 04 13:18:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b558f4-907d-404b-baeb-cbadd23c4f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:18:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Flow 'volume_create_manager' (d6ab8f13-03af-43a1-828f-7f4403d83ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:18:57 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-a5f6ef1d-d3ad-454d-a5c5-fecec33c1318 req-47813cef-3634-45c8-a10a-3e65894972ba tempest-VolumesSnapshotsTestJSON-1942828642 None] Created volume successfully. Jun 04 13:18:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:18:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:18:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] Creating offline snapshot 6ea0e7fc-85f3-413c-b384-6d0b335345d6 of volume 6fe138a3-bfb2-4383-b918-22b258e65b42 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:18:58 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf32461-5bb6-438d-80ac-3806595056ca]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:18:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:58 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 Jun 04 13:18:58 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:59 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42" returned: 0 in 0.970s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:59 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 1G Jun 04 13:18:59 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Acquiring lock "cinder-c12561b5-bfbf-43d1-ba4c-acce7bad794b-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:18:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Lock "cinder-c12561b5-bfbf-43d1-ba4c-acce7bad794b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:18:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Acquiring lock "cinder-quobyte-c12561b5-bfbf-43d1-ba4c-acce7bad794b" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:18:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Lock "cinder-quobyte-c12561b5-bfbf-43d1-ba4c-acce7bad794b" acquired by "delete_volume" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:18:59 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dffc00-6f3c-44fa-b5b6-8e9a37c6af66]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:18:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:59 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b Jun 04 13:18:59 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:18:59 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Jun 04 13:18:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 1G" returned: 0 in 0.860s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:18:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe138a3-bfb2-4383-b918-22b258e65b42 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:18:59 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe138a3-bfb2-4383-b918-22b258e65b42 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 Jun 04 13:19:00 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:00 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b" returned: 0 in 0.787s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:00 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b Jun 04 13:19:00 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:00 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe138a3-bfb2-4383-b918-22b258e65b42 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6" returned: 0 in 0.679s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:00 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 is being set with open permissions: ugo+rw Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:00 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 Jun 04 13:19:00 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:00 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c12561b5-bfbf-43d1-ba4c-acce7bad794b" returned: 0 in 0.598s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Lock "cinder-quobyte-c12561b5-bfbf-43d1-ba4c-acce7bad794b" released by "delete_volume" :: held 1.438s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Created reservations ['9e08ed3e-f03d-4220-ad69-1bc3595fb388', '85a94007-fb80-4f9d-84e3-f033da36b8a7', '0b8022e0-4425-4b29-8dcb-5ec361cbde7c', 'abb41c03-61d2-4d0a-b823-b416aecb482c'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:01 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:19:01 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:01 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6" returned: 0 in 0.633s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:01 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.info Jun 04 13:19:01 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:01 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.598s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:01 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:19:01 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Deleted volume successfully. Jun 04 13:19:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-78a7ee80-cfcd-4a57-a407-6492a0d348d2 tempest-ServerActionsTestOtherA-886526931 None] Lock "cinder-c12561b5-bfbf-43d1-ba4c-acce7bad794b-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:01 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.info" returned: 0 in 0.652s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:01 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.info is being set with open permissions: ugo+rw Jun 04 13:19:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:02 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.info Jun 04 13:19:02 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:02 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.info" returned: 0 in 0.635s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.554s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:02 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-5f4a5c5f-4eef-4f4a-97a9-82435e9be616 req-a0faae07-7d7d-4401-9f5b-9276b50db2bd tempest-VolumesSnapshotsTestJSON-1942828642 None] Create snapshot completed successfully Jun 04 13:19:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Acquiring lock "cinder-6ea0e7fc-85f3-413c-b384-6d0b335345d6-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:19:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "cinder-6ea0e7fc-85f3-413c-b384-6d0b335345d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:19:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Acquiring lock "cinder-quobyte-6fe138a3-bfb2-4383-b918-22b258e65b42" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:19:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "cinder-quobyte-6fe138a3-bfb2-4383-b918-22b258e65b42" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:19:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Acquiring lock "cinder-quobyte-6ea0e7fc-85f3-413c-b384-6d0b335345d6" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:19:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "cinder-quobyte-6ea0e7fc-85f3-413c-b384-6d0b335345d6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:19:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Deleting offline snapshot 6ea0e7fc-85f3-413c-b384-6d0b335345d6 of volume 6fe138a3-bfb2-4383-b918-22b258e65b42 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:19:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] snapshot_file for this snap is: volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:19:03 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[806adcec-4a6d-4b39-bf8e-113a1904ceba]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:19:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:03 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 Jun 04 13:19:03 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:04 devstack sudo[90328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:19:04 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:04 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6" returned: 0 in 0.900s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fe138a3-bfb2-4383-b918-22b258e65b42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee38f52-9508-40ee-944e-2bb88e0103b7]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:04 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 Jun 04 13:19:04 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:04 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.664s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 8 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:19:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:19:04 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42" returned: 0 in 0.866s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:05 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 Jun 04 13:19:05 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:05 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6" returned: 0 in 0.696s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:05 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6 Jun 04 13:19:05 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:06 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42.6ea0e7fc-85f3-413c-b384-6d0b335345d6" returned: 0 in 0.635s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:06 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "cinder-quobyte-6ea0e7fc-85f3-413c-b384-6d0b335345d6" released by "_delete_snapshot" :: held 3.260s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:06 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "cinder-quobyte-6fe138a3-bfb2-4383-b918-22b258e65b42" released by "delete_snapshot" :: held 3.295s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:06 devstack cinder-volume[86722]: WARNING cinder.quota [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:19:06 devstack cinder-volume[86722]: DEBUG cinder.quota [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Created reservations ['22810e27-49d4-429b-bdef-db464b39d7b3', '88841af5-b44f-4f00-ae61-78ab507b6779', '0486eabc-67bf-45e9-8d37-571e4cf82e68', '6fc60630-570d-465f-ac97-2cf64e71aaf7'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:19:06 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Delete snapshot completed successfully. Jun 04 13:19:06 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-237501a7-c9c8-4cc5-b1c1-02c51882c08b req-cf8e6285-d6e2-4ab7-a0ef-bcb02d72cdef tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "cinder-6ea0e7fc-85f3-413c-b384-6d0b335345d6-delete_snapshot" released by "delete_snapshot" :: held 3.454s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Flow 'volume_create_manager' (e09c44cb-f9bd-4f17-8c49-1e6d597d4d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f0d232-be8e-4fc1-8e83-2b821db6019d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f0d232-be8e-4fc1-8e83-2b821db6019d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-807216373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a38ef68-65d3-4c1d-91d5-de6e714a3767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a55391ec259488989424dcf975c4637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:19:07Z,use_quota=True,user_id='94554519f1e4483ab6496aceb19988ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7002829-88a1-4391-9654-e49cd6b5a358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7002829-88a1-4391-9654-e49cd6b5a358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac16acb-48ce-4095-a265-0d70682e983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac16acb-48ce-4095-a265-0d70682e983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a38ef68-65d3-4c1d-91d5-de6e714a3767', 'volume_name': 'volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11a0512-e4f6-4108-9b2b-3daf1447fe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11a0512-e4f6-4108-9b2b-3daf1447fe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6690e3b3-502c-4496-9802-8848db53a93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:07 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Volume 1a38ef68-65d3-4c1d-91d5-de6e714a3767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767', 'volume_size': 1} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-807216373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a38ef68-65d3-4c1d-91d5-de6e714a3767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a55391ec259488989424dcf975c4637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:19:07Z,use_quota=True,user_id='94554519f1e4483ab6496aceb19988ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Creating volume 1a38ef68-65d3-4c1d-91d5-de6e714a3767 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:19:07 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:07 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767 1073741824 Jun 04 13:19:07 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Acquiring lock "cinder-6fe138a3-bfb2-4383-b918-22b258e65b42-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "cinder-6fe138a3-bfb2-4383-b918-22b258e65b42-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Acquiring lock "cinder-quobyte-6fe138a3-bfb2-4383-b918-22b258e65b42" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "cinder-quobyte-6fe138a3-bfb2-4383-b918-22b258e65b42" acquired by "delete_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2755a32-2d82-4ebc-ab04-16989b731db5]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:19:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:07 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 Jun 04 13:19:07 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:08 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767 1073741824" returned: 0 in 1.468s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:08 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767 Jun 04 13:19:08 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:09 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42" returned: 0 in 1.419s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:09 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42 Jun 04 13:19:09 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:09 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767" returned: 0 in 0.670s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.255s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6690e3b3-502c-4496-9802-8848db53a93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8400e665-176b-4974-b5e2-e2ab22a361df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:09 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Volume volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767 (1a38ef68-65d3-4c1d-91d5-de6e714a3767): created successfully Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8400e665-176b-4974-b5e2-e2ab22a361df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Flow 'volume_create_manager' (e09c44cb-f9bd-4f17-8c49-1e6d597d4d70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:19:09 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c97c3460-71ae-44df-819b-05007157b2fe tempest-AttachVolumeShelveTestJSON-1481835787 None] Created volume successfully. Jun 04 13:19:09 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6fe138a3-bfb2-4383-b918-22b258e65b42" returned: 0 in 0.690s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "cinder-quobyte-6fe138a3-bfb2-4383-b918-22b258e65b42" released by "delete_volume" :: held 2.198s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG cinder.quota [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Created reservations ['749f3f8a-ac49-49b2-b984-cc2c179185dc', '83479374-a8b8-4702-bb6c-ba9f0647da46', '73e6765e-34d3-4663-b5b1-3d7c17974d8b', '0f8c2f2b-10bc-4c6a-b1ec-63149a4576b6'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:09 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:19:09 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:10 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.889s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:10 devstack cinder-volume[86722]: DEBUG cinder.manager [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:19:10 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Deleted volume successfully. Jun 04 13:19:10 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-a6e1e841-dc1a-4452-819e-e080eff0d28e req-c234a89e-24ec-4d75-b2d9-7964a55523af tempest-VolumesSnapshotsTestJSON-1942828642 None] Lock "cinder-6fe138a3-bfb2-4383-b918-22b258e65b42-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:17 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b95d151a-55ed-4ea5-850c-e0247d041429 tempest-GroupSnapshotsTest-2105315230 None] Group tempest-GroupSnapshotsTest-Group-323546441: creating Jun 04 13:19:17 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b95d151a-55ed-4ea5-850c-e0247d041429 tempest-GroupSnapshotsTest-2105315230 None] Group tempest-GroupSnapshotsTest-Group-323546441: created successfully Jun 04 13:19:17 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b95d151a-55ed-4ea5-850c-e0247d041429 tempest-GroupSnapshotsTest-2105315230 None] Create group completed successfully. Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Flow 'volume_create_manager' (32d03cc2-7c17-46df-a76c-cf50990ecc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95414a2b-90b6-4dc5-8898-3874cedf91a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95414a2b-90b6-4dc5-8898-3874cedf91a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1678929992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcccc4b0-ecae-48f0-a95a-b2eebb929855,host='devstack@QuobyteHD#QuobyteHD',id=6a72cd2e-5019-47f5-9321-2ed05236b910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bee0986fdc4f9cacc195c1a9c74eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:19:19Z,use_quota=True,user_id='a3a3d4b8897743489b20c819121b6cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a242f680-0c57-4723-953f-c868a11ecd9f),volume_type_id=a242f680-0c57-4723-953f-c868a11ecd9f)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c144c7c-26a7-409d-9932-079fb0963001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c144c7c-26a7-409d-9932-079fb0963001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8184f3-f117-494f-80bb-dcb52848d715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8184f3-f117-494f-80bb-dcb52848d715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a72cd2e-5019-47f5-9321-2ed05236b910', 'volume_name': 'volume-6a72cd2e-5019-47f5-9321-2ed05236b910', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2eaac1d-868f-4661-bb22-ba1ffff2cda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2eaac1d-868f-4661-bb22-ba1ffff2cda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a0c342-d079-4829-a84f-269f4ba2452d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:19 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Volume 6a72cd2e-5019-47f5-9321-2ed05236b910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a72cd2e-5019-47f5-9321-2ed05236b910', 'volume_size': 1} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fcccc4b0-ecae-48f0-a95a-b2eebb929855,created_at=2026-06-04T11:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1678929992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fcccc4b0-ecae-48f0-a95a-b2eebb929855,host='devstack@QuobyteHD#QuobyteHD',id=6a72cd2e-5019-47f5-9321-2ed05236b910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bee0986fdc4f9cacc195c1a9c74eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:19:19Z,use_quota=True,user_id='a3a3d4b8897743489b20c819121b6cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a242f680-0c57-4723-953f-c868a11ecd9f),volume_type_id=a242f680-0c57-4723-953f-c868a11ecd9f)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Creating volume 6a72cd2e-5019-47f5-9321-2ed05236b910 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:19:19 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:19:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:19 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 1073741824 Jun 04 13:19:19 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:20 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 1073741824" returned: 0 in 1.171s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:20 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 Jun 04 13:19:20 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:21 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910" returned: 0 in 0.875s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] <== create_volume: return (2126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:19:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a0c342-d079-4829-a84f-269f4ba2452d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a72cd2e-5019-47f5-9321-2ed05236b910', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628d9644-d297-4a9c-934b-58443b871bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:21 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Volume volume-6a72cd2e-5019-47f5-9321-2ed05236b910 (6a72cd2e-5019-47f5-9321-2ed05236b910): created successfully Jun 04 13:19:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628d9644-d297-4a9c-934b-58443b871bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Flow 'volume_create_manager' (32d03cc2-7c17-46df-a76c-cf50990ecc61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:19:21 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-02e2d8c5-4d07-44d2-b884-44ed8029b98d tempest-GroupSnapshotsTest-2105315230 None] Created volume successfully. Jun 04 13:19:23 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] GroupSnapshot b1b488b2-9160-447d-ba1c-17c5ae12da5e: creating. Jun 04 13:19:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] Group snapshot b1b488b2-9160-447d-ba1c-17c5ae12da5e: creating. {{(pid=86722) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 04 13:19:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] Creating offline snapshot a48b6c51-49a3-47d7-aede-d62c37d2ce58 of volume 6a72cd2e-5019-47f5-9321-2ed05236b910 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:19:23 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d714f0-a337-4b17-8933-07bc6fb14a7f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:19:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:23 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 Jun 04 13:19:23 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:24 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910" returned: 0 in 0.753s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:24 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 1G Jun 04 13:19:24 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:24 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 1G" returned: 0 in 0.780s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a72cd2e-5019-47f5-9321-2ed05236b910 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:24 devstack sudo[90533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a72cd2e-5019-47f5-9321-2ed05236b910 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 Jun 04 13:19:24 devstack sudo[90533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:25 devstack sudo[90533]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a72cd2e-5019-47f5-9321-2ed05236b910 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58" returned: 0 in 0.736s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:25 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:19:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:25 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 Jun 04 13:19:25 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:26 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58" returned: 0 in 0.688s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:26 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.info Jun 04 13:19:26 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:26 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.info" returned: 0 in 0.618s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:26 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:19:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:26 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.info Jun 04 13:19:26 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:27 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.info" returned: 0 in 0.622s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.334s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:27 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-72e927fc-fbb0-4fba-82b6-1864d4abf1da tempest-GroupSnapshotsTest-2105315230 None] group_snapshot b1b488b2-9160-447d-ba1c-17c5ae12da5e: created successfully Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-a48b6c51-49a3-47d7-aede-d62c37d2ce58-2519b4d6-5de3-476a-aecf-fa48d8b3b727" by "_create_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-a48b6c51-49a3-47d7-aede-d62c37d2ce58-2519b4d6-5de3-476a-aecf-fa48d8b3b727" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Creating volume 2519b4d6-5de3-476a-aecf-fa48d8b3b727 from snapshot a48b6c51-49a3-47d7-aede-d62c37d2ce58 {{(pid=86722) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-2519b4d6-5de3-476a-aecf-fa48d8b3b727" by "_copy_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-2519b4d6-5de3-476a-aecf-fa48d8b3b727" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:19:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] snapshot: a48b6c51-49a3-47d7-aede-d62c37d2ce58, volume: 2519b4d6-5de3-476a-aecf-fa48d8b3b727, {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 13:19:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:19:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:19:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:30 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a8b52c-3774-4c02-a216-fe5a4141acbf]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:19:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:30 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 Jun 04 13:19:30 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:31 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58" returned: 0 in 0.981s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a72cd2e-5019-47f5-9321-2ed05236b910(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:19:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 13:19:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Creating direct copy from snapshot {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 13:19:31 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37814ca-3504-420c-8789-dcc28b93f452]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:19:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:31 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 Jun 04 13:19:31 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:31 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910" returned: 0 in 0.820s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:31 devstack cinder-volume[86722]: DEBUG cinder.utils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Path /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727 not found in is_blk_device check {{(pid=86722) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 13:19:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:31 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727 Jun 04 13:19:31 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-85f3fa61-2d40-424f-b42d-cc7804b3021c req-502d7e32-4922-4a5b-828d-8d1c567c17e3 tempest-AttachVolumeShelveTestJSON-1481835787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:39 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727" returned: 0 in 7.237s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:39 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[393f1065-bb14-42ac-98fb-522b50f18cee]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:19:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:39 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 Jun 04 13:19:39 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:40 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910" returned: 0 in 0.920s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:40 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910, size 1024.00 MB, duration 7.24 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727 {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:19:40 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Converted 1024.00 MB image at 141.47 MB/s Jun 04 13:19:40 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:19:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:40 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727 Jun 04 13:19:40 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:40 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727" returned: 0 in 0.592s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-2519b4d6-5de3-476a-aecf-fa48d8b3b727" released by "_copy_volume_from_snapshot" :: held 10.711s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-a48b6c51-49a3-47d7-aede-d62c37d2ce58-2519b4d6-5de3-476a-aecf-fa48d8b3b727" released by "_create_volume_from_snapshot" :: held 10.757s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.786s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-85f3fa61-2d40-424f-b42d-cc7804b3021c req-502d7e32-4922-4a5b-828d-8d1c567c17e3 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.231s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:40 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b229458-968d-4412-a5a5-8beb27e05729]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:19:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-85f3fa61-2d40-424f-b42d-cc7804b3021c req-502d7e32-4922-4a5b-828d-8d1c567c17e3 tempest-AttachVolumeShelveTestJSON-1481835787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:40 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=42,cinder:INSERT=6,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:19:40 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e3d38ad1-5f01-48ce-9b06-5ae0891894a7 tempest-GroupSnapshotsTest-2105315230 None] Create group from source-snapshot-b1b488b2-9160-447d-ba1c-17c5ae12da5e completed successfully. Jun 04 13:19:40 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767 Jun 04 13:19:40 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-2519b4d6-5de3-476a-aecf-fa48d8b3b727" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:19:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-2519b4d6-5de3-476a-aecf-fa48d8b3b727" acquired by "delete_volume" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:19:41 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc733b0d-e8d2-453d-8719-2322dd6e6f34]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:19:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:41 devstack sudo[90701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727 Jun 04 13:19:41 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:41 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-85f3fa61-2d40-424f-b42d-cc7804b3021c req-502d7e32-4922-4a5b-828d-8d1c567c17e3 tempest-AttachVolumeShelveTestJSON-1481835787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767" returned: 0 in 0.840s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-85f3fa61-2d40-424f-b42d-cc7804b3021c req-502d7e32-4922-4a5b-828d-8d1c567c17e3 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.868s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-85f3fa61-2d40-424f-b42d-cc7804b3021c req-502d7e32-4922-4a5b-828d-8d1c567c17e3 tempest-AttachVolumeShelveTestJSON-1481835787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '433ff10c-72b3-4e10-bb41-2ab3ccbe8fc1', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:19:41 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-85f3fa61-2d40-424f-b42d-cc7804b3021c req-502d7e32-4922-4a5b-828d-8d1c567c17e3 tempest-AttachVolumeShelveTestJSON-1481835787 None] attachment_update completed successfully. Jun 04 13:19:42 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727" returned: 0 in 0.798s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:42 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727 Jun 04 13:19:42 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:42 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2519b4d6-5de3-476a-aecf-fa48d8b3b727" returned: 0 in 0.725s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-2519b4d6-5de3-476a-aecf-fa48d8b3b727" released by "delete_volume" :: held 1.590s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:42 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['17a0b756-aa0b-4e0b-8120-8359729cabce'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:19:43 devstack cinder-volume[86722]: WARNING cinder.quota [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-837589742 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-837589742, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:19:43 devstack cinder-volume[86722]: WARNING cinder.quota [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-837589742 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-837589742, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['472dc279-46d1-48b3-9ee1-176d8d151237', '068fdfdd-d9a6-4c2e-adfe-fba096c6040f', '65b2ce35-f50c-4d64-8b4c-b93e6028de70', '03c1c471-5769-40f6-8ac7-6b4ed951a6c3'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:43 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:19:43 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:43 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] group_snapshot b1b488b2-9160-447d-ba1c-17c5ae12da5e: deleting Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] group_snapshot b1b488b2-9160-447d-ba1c-17c5ae12da5e: deleting {{(pid=86722) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-6a72cd2e-5019-47f5-9321-2ed05236b910" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-6a72cd2e-5019-47f5-9321-2ed05236b910" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-a48b6c51-49a3-47d7-aede-d62c37d2ce58" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-a48b6c51-49a3-47d7-aede-d62c37d2ce58" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Deleting offline snapshot a48b6c51-49a3-47d7-aede-d62c37d2ce58 of volume 6a72cd2e-5019-47f5-9321-2ed05236b910 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] snapshot_file for this snap is: volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[94649952-a846-4a6f-8e9a-2d496507a82c]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:43 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.649s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:43 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:19:43 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-753b1c4a-ae98-4b68-ac7e-48a43afc8e0d tempest-GroupSnapshotsTest-2105315230 None] Delete group completed successfully. Jun 04 13:19:43 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 Jun 04 13:19:43 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:44 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58" returned: 0 in 0.846s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a72cd2e-5019-47f5-9321-2ed05236b910(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:19:44 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf13864c-d7f8-46c0-b182-d0b37befb12c]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:19:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:44 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 Jun 04 13:19:44 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:45 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910" returned: 0 in 0.748s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:45 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 Jun 04 13:19:45 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:46 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58" returned: 0 in 0.686s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:46 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58 Jun 04 13:19:46 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:46 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910.a48b6c51-49a3-47d7-aede-d62c37d2ce58" returned: 0 in 0.619s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-a48b6c51-49a3-47d7-aede-d62c37d2ce58" released by "_delete_snapshot" :: held 3.037s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-6a72cd2e-5019-47f5-9321-2ed05236b910" released by "delete_snapshot" :: held 3.077s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:46 devstack cinder-volume[86722]: WARNING cinder.quota [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-837589742 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-837589742, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:19:46 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['c24de78f-8b6f-43d9-bd9f-073c6b8a91cc', '21b1301b-0e2b-4875-bbe3-e4f1aafb4a2c', 'ef405be1-a597-4471-83ef-ee38c4507f09', '0e706b87-a920-478a-a4b7-bc856a1d1ea1'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:19:46 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-26717388-a1bb-4b77-865b-709fe16ac0af tempest-GroupSnapshotsTest-2105315230 None] group_snapshot b1b488b2-9160-447d-ba1c-17c5ae12da5e: deleted successfully Jun 04 13:19:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-6a72cd2e-5019-47f5-9321-2ed05236b910" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:19:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-6a72cd2e-5019-47f5-9321-2ed05236b910" acquired by "delete_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:19:47 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8199ec6-95cd-4012-8ddb-9b0ea7d90a14]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:19:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:47 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 Jun 04 13:19:47 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:48 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910" returned: 0 in 0.860s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:48 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910 Jun 04 13:19:48 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:49 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6a72cd2e-5019-47f5-9321-2ed05236b910" returned: 0 in 0.883s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-6a72cd2e-5019-47f5-9321-2ed05236b910" released by "delete_volume" :: held 1.817s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:19:49 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['c886cb31-7f77-4a24-a133-800c79d4344d'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:19:49 devstack cinder-volume[86722]: WARNING cinder.db.sqlalchemy.api [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-837589742'] Jun 04 13:19:49 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['51b2e665-18c2-4b64-8862-1f864517822d', '86fca03c-347e-477b-b019-7aa663e434af', '95636f86-e2ef-4883-92b6-4f60d72f3eb1', '91a36892-a390-4bef-99e4-f5ad932e3e9c'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:19:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:19:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:19:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:49 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:19:49 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:50 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.979s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:50 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:19:50 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d7932a81-2db3-49c6-8b0f-eef6c348b9d8 tempest-GroupSnapshotsTest-2105315230 None] Delete group completed successfully. Jun 04 13:19:51 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=76,cinder:UPDATE=66,cinder:DELETE=4,cinder:INSERT=22 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:19:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1964edf4-868b-4bb1-a7c2-505e0951ff20 tempest-GroupSnapshotsTest-2105315230 None] Group tempest-GroupSnapshotsTest-Group-1056401885: creating Jun 04 13:19:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1964edf4-868b-4bb1-a7c2-505e0951ff20 tempest-GroupSnapshotsTest-2105315230 None] Group tempest-GroupSnapshotsTest-Group-1056401885: created successfully Jun 04 13:19:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1964edf4-868b-4bb1-a7c2-505e0951ff20 tempest-GroupSnapshotsTest-2105315230 None] Create group completed successfully. Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Flow 'volume_create_manager' (6b7d6cf1-5c2d-40a1-bcd2-7f12fc2ca47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94189252-52cf-492c-941e-016817eaa45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94189252-52cf-492c-941e-016817eaa45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858445853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=921cc2c6-746c-4980-a6e1-7f4075bfa703,host='devstack@QuobyteHD#QuobyteHD',id=7215522a-c8a8-461b-bd9e-98b898409c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bee0986fdc4f9cacc195c1a9c74eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:19:53Z,use_quota=True,user_id='a3a3d4b8897743489b20c819121b6cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31debb1d-567e-4111-8492-7a87403661da),volume_type_id=31debb1d-567e-4111-8492-7a87403661da)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3b3059-aa58-4087-8ab7-b5ace876e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3b3059-aa58-4087-8ab7-b5ace876e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11d148d-67aa-4ccc-a394-5a00cbc3e0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11d148d-67aa-4ccc-a394-5a00cbc3e0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7215522a-c8a8-461b-bd9e-98b898409c4b', 'volume_name': 'volume-7215522a-c8a8-461b-bd9e-98b898409c4b', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4a36e4-8b6b-4dde-8d90-1878382710f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f4a36e4-8b6b-4dde-8d90-1878382710f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9832f74-ee4e-488e-88cb-7e02f12eb7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:53 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Volume 7215522a-c8a8-461b-bd9e-98b898409c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7215522a-c8a8-461b-bd9e-98b898409c4b', 'volume_size': 1} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=921cc2c6-746c-4980-a6e1-7f4075bfa703,created_at=2026-06-04T11:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858445853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=921cc2c6-746c-4980-a6e1-7f4075bfa703,host='devstack@QuobyteHD#QuobyteHD',id=7215522a-c8a8-461b-bd9e-98b898409c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bee0986fdc4f9cacc195c1a9c74eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:19:53Z,use_quota=True,user_id='a3a3d4b8897743489b20c819121b6cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31debb1d-567e-4111-8492-7a87403661da),volume_type_id=31debb1d-567e-4111-8492-7a87403661da)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Creating volume 7215522a-c8a8-461b-bd9e-98b898409c4b {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:19:53 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:19:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:53 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b 1073741824 Jun 04 13:19:53 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:54 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b 1073741824" returned: 0 in 1.146s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:54 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b Jun 04 13:19:54 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:19:55 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Jun 04 13:19:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b" returned: 0 in 1.042s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:19:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] <== create_volume: return (2253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:19:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.260s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9832f74-ee4e-488e-88cb-7e02f12eb7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7215522a-c8a8-461b-bd9e-98b898409c4b', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a64792-3596-45f2-953e-4b68ff3931d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:55 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Volume volume-7215522a-c8a8-461b-bd9e-98b898409c4b (7215522a-c8a8-461b-bd9e-98b898409c4b): created successfully Jun 04 13:19:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a64792-3596-45f2-953e-4b68ff3931d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Flow 'volume_create_manager' (6b7d6cf1-5c2d-40a1-bcd2-7f12fc2ca47d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:19:56 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-661551b7-8d94-4454-b8b3-32331b3f46a0 tempest-GroupSnapshotsTest-2105315230 None] Created volume successfully. Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Flow 'volume_create_manager' (03bc4b27-ce20-40cf-b50f-a192020b74f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83df3f3e-fe60-47e8-833b-d6e269b271b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83df3f3e-fe60-47e8-833b-d6e269b271b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-813520528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=921cc2c6-746c-4980-a6e1-7f4075bfa703,host='devstack@QuobyteHD#QuobyteHD',id=f83f150b-6703-47c6-ad6e-b2ec9f3a89c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bee0986fdc4f9cacc195c1a9c74eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:19:58Z,use_quota=True,user_id='a3a3d4b8897743489b20c819121b6cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31debb1d-567e-4111-8492-7a87403661da),volume_type_id=31debb1d-567e-4111-8492-7a87403661da)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee10c10-2f51-4564-add8-e30aeed11b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee10c10-2f51-4564-add8-e30aeed11b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf92cda-1b5a-45ac-a847-c47a2a25a14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf92cda-1b5a-45ac-a847-c47a2a25a14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83f150b-6703-47c6-ad6e-b2ec9f3a89c5', 'volume_name': 'volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7de03f4-8953-4f0b-953c-53f07215087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7de03f4-8953-4f0b-953c-53f07215087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0381e2-1145-468f-ba5b-4e18f2f27c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:19:58 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Volume f83f150b-6703-47c6-ad6e-b2ec9f3a89c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5', 'volume_size': 1} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=921cc2c6-746c-4980-a6e1-7f4075bfa703,created_at=2026-06-04T11:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-813520528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=921cc2c6-746c-4980-a6e1-7f4075bfa703,host='devstack@QuobyteHD#QuobyteHD',id=f83f150b-6703-47c6-ad6e-b2ec9f3a89c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bee0986fdc4f9cacc195c1a9c74eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:19:58Z,use_quota=True,user_id='a3a3d4b8897743489b20c819121b6cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31debb1d-567e-4111-8492-7a87403661da),volume_type_id=31debb1d-567e-4111-8492-7a87403661da)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Creating volume f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:19:58 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:19:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:19:58 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 1073741824 Jun 04 13:19:58 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:00 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 1073741824" returned: 0 in 1.743s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:00 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 Jun 04 13:20:00 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:02 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5" returned: 0 in 1.720s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] <== create_volume: return (3635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:20:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.644s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0381e2-1145-468f-ba5b-4e18f2f27c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1560822-b0fd-41b9-a06a-2b3b72cb7e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:02 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Volume volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 (f83f150b-6703-47c6-ad6e-b2ec9f3a89c5): created successfully Jun 04 13:20:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1560822-b0fd-41b9-a06a-2b3b72cb7e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Flow 'volume_create_manager' (03bc4b27-ce20-40cf-b50f-a192020b74f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:20:02 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-7ba56f96-2b82-49b6-a5a7-b13e54c31e79 tempest-GroupSnapshotsTest-2105315230 None] Created volume successfully. Jun 04 13:20:03 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6919658e-37d5-4924-8e61-1f5f304fa8c5 tempest-GroupSnapshotsTest-2105315230 None] Update group completed successfully. Jun 04 13:20:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:20:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:20:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:20:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:04 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:20:04 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:05 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.055s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:05 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:20:05 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:20:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 8 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:20:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:20:05 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-7ca849ad-942f-44dc-b53f-0f0e908682c9 tempest-GroupSnapshotsTest-2105315230 None] Update group completed successfully. Jun 04 13:20:06 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d7b01323-e466-433c-839e-217987c81954 tempest-GroupSnapshotsTest-2105315230 None] Update group completed successfully. Jun 04 13:20:07 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-aff8e433-1a3d-4d99-bfe8-a79cfb35cc35 tempest-GroupSnapshotsTest-2105315230 None] Update group completed successfully. Jun 04 13:20:09 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] GroupSnapshot 690d4795-e3f2-4470-b9e1-8439778e599d: creating. Jun 04 13:20:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Group snapshot 690d4795-e3f2-4470-b9e1-8439778e599d: creating. {{(pid=86722) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 04 13:20:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Creating offline snapshot c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 of volume f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:20:09 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fa525a-aaad-47a2-a5ee-1090420d0c55]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:10 devstack sudo[91612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 Jun 04 13:20:10 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:11 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5" returned: 0 in 1.863s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:11 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 1G Jun 04 13:20:11 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:13 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 1G" returned: 0 in 2.044s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:13 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 Jun 04 13:20:13 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:15 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7" returned: 0 in 1.504s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:15 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:20:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:15 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 Jun 04 13:20:15 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:16 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7" returned: 0 in 1.298s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:16 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.info Jun 04 13:20:16 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:17 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:20:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Flow 'volume_create_manager' (1c479471-a360-44d0-baa3-996e98d0e644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:20:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d4bf8d-0b70-4f51-8ed9-394a57bf1053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:18 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d4bf8d-0b70-4f51-8ed9-394a57bf1053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1542089642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aabacf0-7e32-4577-a5b4-35bb4a616f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80973184e0be46d2817eb703acb9d90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:20:18Z,use_quota=True,user_id='a9e0e948f38f4f119fb56cf2eb30724a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:18 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:18 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae51850-9061-4fb3-a574-093a561286da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:18 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae51850-9061-4fb3-a574-093a561286da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:18 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4919ea-8d5e-49b8-ae5b-3c612d9f37b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:18 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4919ea-8d5e-49b8-ae5b-3c612d9f37b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aabacf0-7e32-4577-a5b4-35bb4a616f92', 'volume_name': 'volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:18 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4d33d8-1c67-4b72-81d0-217d3aef174b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:18 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4d33d8-1c67-4b72-81d0-217d3aef174b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:18 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6ea2a8-b167-4e38-8f16-f866389104e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:18 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Volume 0aabacf0-7e32-4577-a5b4-35bb4a616f92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92', 'volume_size': 1} Jun 04 13:20:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.info" returned: 0 in 1.487s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:18 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:20:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:18 devstack sudo[91706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.info Jun 04 13:20:18 devstack sudo[91706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:19 devstack sudo[91706]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.info" returned: 0 in 0.942s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.284s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Creating offline snapshot d9d6214f-95c2-447a-8216-5d49cd57334e of volume 7215522a-c8a8-461b-bd9e-98b898409c4b {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:20:19 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7d5661-a97d-4acd-97c9-4604fe855bb1]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:19 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b Jun 04 13:20:19 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:20 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b" returned: 0 in 1.013s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:20 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e 1G Jun 04 13:20:20 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:20 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e 1G" returned: 0 in 0.880s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7215522a-c8a8-461b-bd9e-98b898409c4b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:21 devstack sudo[91719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7215522a-c8a8-461b-bd9e-98b898409c4b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e Jun 04 13:20:21 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:21 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7215522a-c8a8-461b-bd9e-98b898409c4b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e" returned: 0 in 0.721s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:21 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:20:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:21 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e Jun 04 13:20:21 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:22 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e" returned: 0 in 0.692s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:22 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.info Jun 04 13:20:22 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:23 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.info" returned: 0 in 0.688s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:23 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:23 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.info Jun 04 13:20:23 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:23 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.info" returned: 0 in 0.612s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.718s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.685s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1542089642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aabacf0-7e32-4577-a5b4-35bb4a616f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80973184e0be46d2817eb703acb9d90d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:20:18Z,use_quota=True,user_id='a9e0e948f38f4f119fb56cf2eb30724a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Creating volume 0aabacf0-7e32-4577-a5b4-35bb4a616f92 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:20:23 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:20:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:23 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92 1073741824 Jun 04 13:20:23 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:23 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-244b6fff-c154-4e98-b7b5-496fdfe5a7ab tempest-GroupSnapshotsTest-2105315230 None] group_snapshot 690d4795-e3f2-4470-b9e1-8439778e599d: created successfully Jun 04 13:20:24 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92 1073741824" returned: 0 in 0.958s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:24 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92 Jun 04 13:20:24 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:25 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] group_snapshot 690d4795-e3f2-4470-b9e1-8439778e599d: deleting Jun 04 13:20:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] group_snapshot 690d4795-e3f2-4470-b9e1-8439778e599d: deleting {{(pid=86722) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 04 13:20:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:20:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:20:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:20:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:20:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Deleting offline snapshot c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 of volume f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:20:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] snapshot_file for this snap is: volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:20:25 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4883e8a-52fe-4ea9-9194-6e42392c880e]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:25 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 Jun 04 13:20:25 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:26 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92" returned: 0 in 1.260s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] <== create_volume: return (2267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:20:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.271s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b6ea2a8-b167-4e38-8f16-f866389104e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b72a60-2676-42fd-9f84-a8816e1b2fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:26 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Volume volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92 (0aabacf0-7e32-4577-a5b4-35bb4a616f92): created successfully Jun 04 13:20:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b72a60-2676-42fd-9f84-a8816e1b2fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Flow 'volume_create_manager' (1c479471-a360-44d0-baa3-996e98d0e644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:20:26 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ef5c80e9-4ebc-488d-9dff-5d978671eff0 tempest-ServerRescueNegativeTestJSON-1596140896 None] Created volume successfully. Jun 04 13:20:26 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7" returned: 0 in 0.996s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:20:26 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c0dcd7-b2f1-49e4-842a-f7b617cec33b]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:26 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 Jun 04 13:20:26 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:27 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5" returned: 0 in 1.140s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:27 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 Jun 04 13:20:27 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:28 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7" returned: 0 in 0.952s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:28 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7 Jun 04 13:20:28 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:29 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5.c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7" returned: 0 in 0.732s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-c75a1a3b-1b0e-4097-a1a8-8b66f63b9cd7" released by "_delete_snapshot" :: held 4.034s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:20:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5" released by "delete_snapshot" :: held 4.086s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:20:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-7215522a-c8a8-461b-bd9e-98b898409c4b" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:20:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-7215522a-c8a8-461b-bd9e-98b898409c4b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:20:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-d9d6214f-95c2-447a-8216-5d49cd57334e" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:20:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-d9d6214f-95c2-447a-8216-5d49cd57334e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:20:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Deleting offline snapshot d9d6214f-95c2-447a-8216-5d49cd57334e of volume 7215522a-c8a8-461b-bd9e-98b898409c4b {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:20:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] snapshot_file for this snap is: volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:20:29 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84723a9-5e3b-4be2-a7ac-2374fb5630cb]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:29 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e Jun 04 13:20:29 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:30 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e" returned: 0 in 0.796s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7215522a-c8a8-461b-bd9e-98b898409c4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:20:30 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ff8f81-a2e1-45c4-9576-65034644b9e8]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:30 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b Jun 04 13:20:30 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:31 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b" returned: 0 in 1.326s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:31 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e Jun 04 13:20:31 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:32 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e" returned: 0 in 1.026s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:32 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e Jun 04 13:20:32 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:33 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b.d9d6214f-95c2-447a-8216-5d49cd57334e" returned: 0 in 0.619s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-d9d6214f-95c2-447a-8216-5d49cd57334e" released by "_delete_snapshot" :: held 3.861s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:20:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-7215522a-c8a8-461b-bd9e-98b898409c4b" released by "delete_snapshot" :: held 3.884s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:20:33 devstack cinder-volume[86722]: WARNING cinder.quota [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1578584547 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1578584547, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:20:33 devstack cinder-volume[86722]: WARNING cinder.quota [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1578584547 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1578584547, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:20:33 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['01217150-1b6a-4064-aeaa-30181b902bc5', '3c9e83ea-5e42-49f4-a829-038d3cb12207', '4085b944-bad8-46bf-9eb7-255561ce4d6f', '3bbd48af-7036-4c5b-b243-8bd18cb2f27a'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:20:33 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['08db21f8-3efd-4901-9973-18ed37be9f3f', '04d41560-998e-44e4-b836-5620800488de', '9c836d95-e201-49ea-a870-657b9eee5176', 'd455a6e0-b4af-4cf9-b24c-848ba7f54c94'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:20:33 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-123bb413-ad8f-4574-bb21-d9c47a566796 tempest-GroupSnapshotsTest-2105315230 None] group_snapshot 690d4795-e3f2-4470-b9e1-8439778e599d: deleted successfully Jun 04 13:20:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-7215522a-c8a8-461b-bd9e-98b898409c4b" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:20:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-7215522a-c8a8-461b-bd9e-98b898409c4b" acquired by "delete_volume" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:20:34 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab571bf7-cf21-4b7d-b75b-d92996a62cb4]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:34 devstack sudo[91937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b Jun 04 13:20:34 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:35 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b" returned: 0 in 0.718s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:35 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b Jun 04 13:20:35 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:35 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7215522a-c8a8-461b-bd9e-98b898409c4b" returned: 0 in 0.595s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-7215522a-c8a8-461b-bd9e-98b898409c4b" released by "delete_volume" :: held 1.385s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:20:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:20:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5" acquired by "delete_volume" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:20:36 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[6909871d-64ea-44c7-8443-675924cc72fa]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:36 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 Jun 04 13:20:36 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:36 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5" returned: 0 in 0.957s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:37 devstack sudo[91991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5 Jun 04 13:20:37 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:37 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5" returned: 0 in 0.643s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-f83f150b-6703-47c6-ad6e-b2ec9f3a89c5" released by "delete_volume" :: held 1.669s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:20:37 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['f41beb03-cc5e-4c41-a6db-1e70f0e08975'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:20:37 devstack cinder-volume[86722]: WARNING cinder.quota [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1578584547 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1578584547, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:20:37 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['beb6c6a8-87fb-4c00-b55e-73864c0a7a33', '7459fe24-c6de-455b-a1a0-f35e16d4a5c0', 'e809e62d-05ee-4b2e-9df7-d6da7d779e81', '80a490ad-a248-4f26-8bc8-b0834fb18ee6'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:20:37 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['fba89d61-9401-41ad-938d-33bf36c941d4', '8ffd8886-cd9e-4f7d-96da-0cf97545b99d', '895616c8-b8dd-4779-9037-1e5d16d810f1', '6ef61b44-b7cc-49de-ad8f-fed93ef28d86'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:20:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:20:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:20:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:38 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:20:38 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:39 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.942s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:39 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:20:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fa143ce8-5fdb-42aa-be8c-15417786526d tempest-GroupSnapshotsTest-2105315230 None] Delete group completed successfully. Jun 04 13:20:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ae237611-b7df-436a-a584-5ae0297469b9 tempest-GroupSnapshotsTest-2105315230 None] Group tempest-GroupSnapshotsTest-Group-1004167183: creating Jun 04 13:20:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ae237611-b7df-436a-a584-5ae0297469b9 tempest-GroupSnapshotsTest-2105315230 None] Group tempest-GroupSnapshotsTest-Group-1004167183: created successfully Jun 04 13:20:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ae237611-b7df-436a-a584-5ae0297469b9 tempest-GroupSnapshotsTest-2105315230 None] Create group completed successfully. Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=84,cinder:UPDATE=78,cinder:INSERT=15,cinder:DELETE=1 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Flow 'volume_create_manager' (bf98a27b-0e54-4ad4-9766-e24f2d5d543a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c6cf31-a0ed-4b91-b2c0-0962ae837176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c6cf31-a0ed-4b91-b2c0-0962ae837176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1419969187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=036f98d3-07a7-4aaf-8f09-a7767c490239,host='devstack@QuobyteHD#QuobyteHD',id=93a46e74-1e66-46d6-b5cd-9f25cb4f967e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bee0986fdc4f9cacc195c1a9c74eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:20:41Z,use_quota=True,user_id='a3a3d4b8897743489b20c819121b6cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f33f459-bd73-42d2-92f2-d74eedbb797a),volume_type_id=3f33f459-bd73-42d2-92f2-d74eedbb797a)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9318c09-0e39-4fc0-8461-79a8e1208344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9318c09-0e39-4fc0-8461-79a8e1208344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c32a466-5051-4354-b2f6-8f81be1ef9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c32a466-5051-4354-b2f6-8f81be1ef9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a46e74-1e66-46d6-b5cd-9f25cb4f967e', 'volume_name': 'volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f684609-472c-4671-9c7b-b14ce8e47b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f684609-472c-4671-9c7b-b14ce8e47b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b52a744-1ea1-4940-9f9a-1832dbe83a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:41 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Volume 93a46e74-1e66-46d6-b5cd-9f25cb4f967e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e', 'volume_size': 1} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=036f98d3-07a7-4aaf-8f09-a7767c490239,created_at=2026-06-04T11:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1419969187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=036f98d3-07a7-4aaf-8f09-a7767c490239,host='devstack@QuobyteHD#QuobyteHD',id=93a46e74-1e66-46d6-b5cd-9f25cb4f967e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54bee0986fdc4f9cacc195c1a9c74eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:20:41Z,use_quota=True,user_id='a3a3d4b8897743489b20c819121b6cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f33f459-bd73-42d2-92f2-d74eedbb797a),volume_type_id=3f33f459-bd73-42d2-92f2-d74eedbb797a)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Creating volume 93a46e74-1e66-46d6-b5cd-9f25cb4f967e {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:20:41 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:20:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:41 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e 1073741824 Jun 04 13:20:41 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:43 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e 1073741824" returned: 0 in 1.540s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:43 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e Jun 04 13:20:43 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:43 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e" returned: 0 in 0.695s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:20:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.332s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b52a744-1ea1-4940-9f9a-1832dbe83a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b6f9fb-e2e6-4faf-85b3-de10899612fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:43 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Volume volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e (93a46e74-1e66-46d6-b5cd-9f25cb4f967e): created successfully Jun 04 13:20:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b6f9fb-e2e6-4faf-85b3-de10899612fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Flow 'volume_create_manager' (bf98a27b-0e54-4ad4-9766-e24f2d5d543a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:20:43 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8c132128-f798-48f8-84d5-1cd87a85d7bd tempest-GroupSnapshotsTest-2105315230 None] Created volume successfully. Jun 04 13:20:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Acquiring lock "cinder-0aabacf0-7e32-4577-a5b4-35bb4a616f92-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:20:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Lock "cinder-0aabacf0-7e32-4577-a5b4-35bb4a616f92-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:20:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Acquiring lock "cinder-quobyte-0aabacf0-7e32-4577-a5b4-35bb4a616f92" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:20:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Lock "cinder-quobyte-0aabacf0-7e32-4577-a5b4-35bb4a616f92" acquired by "delete_volume" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:20:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] GroupSnapshot 600a87c1-4cf8-4e9c-a958-3348c9e5bd5d: creating. Jun 04 13:20:45 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b586a51-f2dc-4c15-94d7-c4775302021a]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] Group snapshot 600a87c1-4cf8-4e9c-a958-3348c9e5bd5d: creating. {{(pid=86722) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 04 13:20:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] Creating offline snapshot 22ae18f6-1629-4a3a-8bd5-0a3c81bb850c of volume 93a46e74-1e66-46d6-b5cd-9f25cb4f967e {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:20:45 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b37fd2-8266-4627-b1b4-4cfe1f5820cd]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:45 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92 Jun 04 13:20:45 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:45 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e Jun 04 13:20:45 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:46 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e" returned: 0 in 0.760s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:46 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92" returned: 0 in 0.849s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:46 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c 1G Jun 04 13:20:46 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:46 devstack sudo[92142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92 Jun 04 13:20:46 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:46 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0aabacf0-7e32-4577-a5b4-35bb4a616f92" returned: 0 in 0.616s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Lock "cinder-quobyte-0aabacf0-7e32-4577-a5b4-35bb4a616f92" released by "delete_volume" :: held 1.528s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Created reservations ['e8d5bbf6-9916-4406-b36c-9c477ff08505', '7420d2f6-1040-4a18-ada1-247b52b9bdf5', 'fd8b847e-7c4e-4519-9fe2-b563c68a7dc4', 'b622cee0-fdec-4988-9a9d-6025b4ccdd15'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:46 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:20:46 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:46 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c 1G" returned: 0 in 0.883s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:46 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c Jun 04 13:20:46 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:47 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.724s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:47 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:20:47 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Deleted volume successfully. Jun 04 13:20:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-259c4c8c-5689-4b77-a4d2-6caf1589c021 tempest-ServerRescueNegativeTestJSON-1596140896 None] Lock "cinder-0aabacf0-7e32-4577-a5b4-35bb4a616f92-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:20:47 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c" returned: 0 in 0.751s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:47 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:20:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:47 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c Jun 04 13:20:47 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:48 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c" returned: 0 in 0.641s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:48 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.info Jun 04 13:20:48 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:49 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.info" returned: 0 in 1.081s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:49 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:20:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:49 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.info Jun 04 13:20:49 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:50 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.info" returned: 0 in 0.691s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.916s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:50 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-53cf093d-7abd-4176-a1be-f1f21cd66f84 tempest-GroupSnapshotsTest-2105315230 None] group_snapshot 600a87c1-4cf8-4e9c-a958-3348c9e5bd5d: created successfully Jun 04 13:20:50 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-379b0651-0c87-4c72-980b-90358ed1d032 req-cf2f7307-a085-457d-ac0b-4d510b5f982a tempest-AttachVolumeShelveTestJSON-1481835787 None] Terminate volume connection completed successfully. Jun 04 13:20:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-379b0651-0c87-4c72-980b-90358ed1d032 req-cf2f7307-a085-457d-ac0b-4d510b5f982a tempest-AttachVolumeShelveTestJSON-1481835787 None] Deleting attachment 433ff10c-72b3-4e10-bb41-2ab3ccbe8fc1. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:20:50 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] group_snapshot 600a87c1-4cf8-4e9c-a958-3348c9e5bd5d: deleting Jun 04 13:20:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] group_snapshot 600a87c1-4cf8-4e9c-a958-3348c9e5bd5d: deleting {{(pid=86722) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 04 13:20:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-93a46e74-1e66-46d6-b5cd-9f25cb4f967e" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:20:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-93a46e74-1e66-46d6-b5cd-9f25cb4f967e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:20:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-22ae18f6-1629-4a3a-8bd5-0a3c81bb850c" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:20:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-22ae18f6-1629-4a3a-8bd5-0a3c81bb850c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:20:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Deleting offline snapshot 22ae18f6-1629-4a3a-8bd5-0a3c81bb850c of volume 93a46e74-1e66-46d6-b5cd-9f25cb4f967e {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:20:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] snapshot_file for this snap is: volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:20:50 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c932e1e-ef9c-40b4-b751-44c988b6e033]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:51 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c Jun 04 13:20:51 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:51 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c" returned: 0 in 0.749s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:20:51 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aec1ed1-3725-4cb5-b743-4a5dc2aa97be]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:51 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e Jun 04 13:20:51 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:52 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e" returned: 0 in 0.804s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:52 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c Jun 04 13:20:52 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:53 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c" returned: 0 in 0.990s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:53 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c Jun 04 13:20:53 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=63,cinder:UPDATE=66,cinder:INSERT=17,cinder:DELETE=2 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Flow 'volume_create_manager' (b8a98758-0a4d-46b6-b080-8a48f61cf321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152184e1-929a-42d2-8d0a-1c9887f64fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152184e1-929a-42d2-8d0a-1c9887f64fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1969062523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16a034f-7262-4009-80ef-04e82a7094fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88233746d6e94b17927083d67c47fd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:20:54Z,use_quota=True,user_id='307b875628814a968259145eb7157b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28106fde-ab16-4acb-8bea-80ea9e47f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28106fde-ab16-4acb-8bea-80ea9e47f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce24c89-3126-417b-9f95-0533e8b7b43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce24c89-3126-417b-9f95-0533e8b7b43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16a034f-7262-4009-80ef-04e82a7094fe', 'volume_name': 'volume-b16a034f-7262-4009-80ef-04e82a7094fe', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e12778-e863-47f3-975b-ba041d502abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e12778-e863-47f3-975b-ba041d502abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012c8bed-fdef-46a5-9065-bb204ec0b34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:53 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Volume b16a034f-7262-4009-80ef-04e82a7094fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16a034f-7262-4009-80ef-04e82a7094fe', 'volume_size': 1} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1969062523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16a034f-7262-4009-80ef-04e82a7094fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88233746d6e94b17927083d67c47fd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:20:54Z,use_quota=True,user_id='307b875628814a968259145eb7157b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Creating volume b16a034f-7262-4009-80ef-04e82a7094fe {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:20:53 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:20:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:53 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe 1073741824 Jun 04 13:20:53 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:54 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e.22ae18f6-1629-4a3a-8bd5-0a3c81bb850c" returned: 0 in 1.012s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-22ae18f6-1629-4a3a-8bd5-0a3c81bb850c" released by "_delete_snapshot" :: held 3.743s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:20:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-93a46e74-1e66-46d6-b5cd-9f25cb4f967e" released by "delete_snapshot" :: held 3.788s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:20:54 devstack cinder-volume[86722]: WARNING cinder.quota [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1948486146 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1948486146, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:20:54 devstack cinder-volume[86722]: WARNING cinder.quota [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1948486146 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1948486146, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:20:54 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['529ee08e-8bf1-4031-ad43-cb41d3340d7f', '83f55c0c-b7eb-4e2c-9746-722c622abef9', '72d9aa93-e1a3-48d5-98c4-b371a85493ec', '3a88fc3e-92ce-4231-acc6-e89a1a5fbd37'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:20:55 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9362e1c6-04d7-4905-a93a-87db014da07c tempest-GroupSnapshotsTest-2105315230 None] group_snapshot 600a87c1-4cf8-4e9c-a958-3348c9e5bd5d: deleted successfully Jun 04 13:20:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "cinder-quobyte-93a46e74-1e66-46d6-b5cd-9f25cb4f967e" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:20:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-93a46e74-1e66-46d6-b5cd-9f25cb4f967e" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:20:55 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d791da9-1ae3-4ede-bc4f-809731b95381]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:20:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:56 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe 1073741824" returned: 0 in 2.119s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:56 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe Jun 04 13:20:56 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:56 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e Jun 04 13:20:56 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:57 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe" returned: 0 in 0.976s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] <== create_volume: return (3193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:20:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.196s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012c8bed-fdef-46a5-9065-bb204ec0b34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16a034f-7262-4009-80ef-04e82a7094fe', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f7897c-ba96-438c-90de-588291ba60ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:20:57 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Volume volume-b16a034f-7262-4009-80ef-04e82a7094fe (b16a034f-7262-4009-80ef-04e82a7094fe): created successfully Jun 04 13:20:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f7897c-ba96-438c-90de-588291ba60ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:20:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Flow 'volume_create_manager' (b8a98758-0a4d-46b6-b080-8a48f61cf321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:20:57 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-66de4e1f-1d07-47cb-9c0f-4648965f349d tempest-AttachVolumeTestJSON-1108399174 None] Created volume successfully. Jun 04 13:20:57 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e" returned: 0 in 1.316s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:57 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e Jun 04 13:20:57 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:57 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-93a46e74-1e66-46d6-b5cd-9f25cb4f967e" returned: 0 in 0.739s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Lock "cinder-quobyte-93a46e74-1e66-46d6-b5cd-9f25cb4f967e" released by "delete_volume" :: held 2.149s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:20:58 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['c54965aa-aa1c-4f92-bb13-eaa44281f507'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:20:58 devstack cinder-volume[86722]: WARNING cinder.quota [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1948486146 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1948486146, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:20:58 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Created reservations ['dcdbf179-885b-4489-be27-d798c82a45a7', '485274c7-eabd-4218-9ba6-ffae7e0e3bed', 'c92a019d-5fbd-44cf-bd55-9c009ca90dd8', '79507884-ffec-47fc-82e3-445baefd1c1a'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:20:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:20:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:20:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:20:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:20:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:20:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:20:58 devstack sudo[92326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:20:58 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:20:58 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root Jun 04 13:20:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.640s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:20:58 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:20:59 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-195649fb-7808-4413-ae77-a275eb6a89ad tempest-GroupSnapshotsTest-2105315230 None] Delete group completed successfully. Jun 04 13:21:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-0038e110-5764-4140-861d-32b44b156b23 req-4658e57c-c7a7-4a5a-ae1d-5d306ec2975f tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-0038e110-5764-4140-861d-32b44b156b23 req-4658e57c-c7a7-4a5a-ae1d-5d306ec2975f tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:01 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf63815f-7e47-47e5-9214-447f8dfa9b15]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-0038e110-5764-4140-861d-32b44b156b23 req-4658e57c-c7a7-4a5a-ae1d-5d306ec2975f tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:01 devstack sudo[92340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe Jun 04 13:21:01 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:02 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-0038e110-5764-4140-861d-32b44b156b23 req-4658e57c-c7a7-4a5a-ae1d-5d306ec2975f tempest-AttachVolumeTestJSON-1108399174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe" returned: 0 in 0.912s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-0038e110-5764-4140-861d-32b44b156b23 req-4658e57c-c7a7-4a5a-ae1d-5d306ec2975f tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.936s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-0038e110-5764-4140-861d-32b44b156b23 req-4658e57c-c7a7-4a5a-ae1d-5d306ec2975f tempest-AttachVolumeTestJSON-1108399174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-b16a034f-7262-4009-80ef-04e82a7094fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ad51e62-5825-4f3f-a6b8-53460c344f28', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:21:02 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-0038e110-5764-4140-861d-32b44b156b23 req-4658e57c-c7a7-4a5a-ae1d-5d306ec2975f tempest-AttachVolumeTestJSON-1108399174 None] attachment_update completed successfully. Jun 04 13:21:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:21:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:04 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:21:04 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:04 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.910s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:21:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:21:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 8 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:21:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Flow 'volume_create_manager' (9c3d38ba-eaee-4b38-922a-93fc9b981f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed13ea4-f0a9-489d-af1d-504193ba53fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed13ea4-f0a9-489d-af1d-504193ba53fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1662062679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208a4dd0-272e-4004-8219-5446902ca5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88233746d6e94b17927083d67c47fd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:08Z,use_quota=True,user_id='307b875628814a968259145eb7157b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29914ddb-fd37-42d8-b006-7b15447f6416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29914ddb-fd37-42d8-b006-7b15447f6416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d0b2c6-46a7-4c43-9d4d-df10624fea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d0b2c6-46a7-4c43-9d4d-df10624fea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208a4dd0-272e-4004-8219-5446902ca5d2', 'volume_name': 'volume-208a4dd0-272e-4004-8219-5446902ca5d2', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3d1bae-dc0a-402d-83f0-6414343bd09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3d1bae-dc0a-402d-83f0-6414343bd09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c6a617-0737-4ee8-abe7-46bd484e004e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:08 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Volume 208a4dd0-272e-4004-8219-5446902ca5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208a4dd0-272e-4004-8219-5446902ca5d2', 'volume_size': 1} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1662062679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208a4dd0-272e-4004-8219-5446902ca5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88233746d6e94b17927083d67c47fd76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:08Z,use_quota=True,user_id='307b875628814a968259145eb7157b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Creating volume 208a4dd0-272e-4004-8219-5446902ca5d2 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:21:08 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:21:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:08 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2 1073741824 Jun 04 13:21:08 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:09 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2 1073741824" returned: 0 in 0.929s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:09 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2 Jun 04 13:21:09 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:10 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2" returned: 0 in 0.641s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:10 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:21:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:10 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c6a617-0737-4ee8-abe7-46bd484e004e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208a4dd0-272e-4004-8219-5446902ca5d2', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:10 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20bec34-3c0c-4bb3-9fa6-ea86f242162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:10 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Volume volume-208a4dd0-272e-4004-8219-5446902ca5d2 (208a4dd0-272e-4004-8219-5446902ca5d2): created successfully Jun 04 13:21:10 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20bec34-3c0c-4bb3-9fa6-ea86f242162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:10 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Flow 'volume_create_manager' (9c3d38ba-eaee-4b38-922a-93fc9b981f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:10 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-024dba83-63e9-4b40-af5a-3ad03c60915c tempest-AttachVolumeTestJSON-1108399174 None] Created volume successfully. Jun 04 13:21:11 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1b69afb8-7b94-461f-bab9-04896fc155ee tempest-GroupsTest-1490568282 None] Group tempest-Group1-64129095: creating Jun 04 13:21:11 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1b69afb8-7b94-461f-bab9-04896fc155ee tempest-GroupsTest-1490568282 None] Group tempest-Group1-64129095: created successfully Jun 04 13:21:11 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1b69afb8-7b94-461f-bab9-04896fc155ee tempest-GroupsTest-1490568282 None] Create group completed successfully. Jun 04 13:21:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2ccc21e-adc5-4cfa-bdd7-6bbf3a60e586 tempest-BackendsCapabilitiesAdminTestsJSON-608087334 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579879760742, 'free_capacity_gb': 1775.7579879760742, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86722) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jun 04 13:21:12 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-29454019-9439-4e68-afb8-4fc7a315a34e tempest-GroupsTest-1490568282 None] Group tempest-Group2-2117982412: creating Jun 04 13:21:12 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-29454019-9439-4e68-afb8-4fc7a315a34e tempest-GroupsTest-1490568282 None] Group tempest-Group2-2117982412: created successfully Jun 04 13:21:12 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-29454019-9439-4e68-afb8-4fc7a315a34e tempest-GroupsTest-1490568282 None] Create group completed successfully. Jun 04 13:21:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-eff5f431-200b-42ca-9f89-16c090c05e76 tempest-BackendsCapabilitiesAdminTestsJSON-608087334 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579879760742, 'free_capacity_gb': 1775.7579879760742, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86722) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jun 04 13:21:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-efc6117b-c058-46e0-a543-750b9fcf1210 req-5bcfb15d-902a-4909-9994-52407cfa5158 tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-efc6117b-c058-46e0-a543-750b9fcf1210 req-5bcfb15d-902a-4909-9994-52407cfa5158 tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:13 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ff4c01-c848-49db-9387-70dc5c6676cf]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-efc6117b-c058-46e0-a543-750b9fcf1210 req-5bcfb15d-902a-4909-9994-52407cfa5158 tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:13 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2 Jun 04 13:21:13 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Flow 'volume_create_manager' (8531c2e3-b87b-4ee4-960f-84dc1a8fca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307bf1b0-7e49-4c22-8069-78aba19bb0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307bf1b0-7e49-4c22-8069-78aba19bb0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858017962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=657ae9de-0ef0-4601-be7f-15217af68852,host='devstack@QuobyteHD#QuobyteHD',id=c975031e-0778-470a-8660-cb9bcc9a6564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5e5404020d4ef690c80500ef080b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:14Z,use_quota=True,user_id='7c68df2f3314437b8f5f2f72dfd08609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad279305-97f4-48f5-9543-e28289c68db8),volume_type_id=ad279305-97f4-48f5-9543-e28289c68db8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d746b6-f117-4b20-9175-f44bc067bea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d746b6-f117-4b20-9175-f44bc067bea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fff8e2-46de-4a2a-90ed-88f3291a12c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fff8e2-46de-4a2a-90ed-88f3291a12c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c975031e-0778-470a-8660-cb9bcc9a6564', 'volume_name': 'volume-c975031e-0778-470a-8660-cb9bcc9a6564', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77db46d3-1e45-4638-bc25-c00a973a9937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77db46d3-1e45-4638-bc25-c00a973a9937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412b0d30-d95a-4259-b254-1fad1ab1a168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:14 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Volume c975031e-0778-470a-8660-cb9bcc9a6564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c975031e-0778-470a-8660-cb9bcc9a6564', 'volume_size': 1} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:14 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-efc6117b-c058-46e0-a543-750b9fcf1210 req-5bcfb15d-902a-4909-9994-52407cfa5158 tempest-AttachVolumeTestJSON-1108399174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2" returned: 0 in 0.895s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-efc6117b-c058-46e0-a543-750b9fcf1210 req-5bcfb15d-902a-4909-9994-52407cfa5158 tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.926s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.295s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=657ae9de-0ef0-4601-be7f-15217af68852,created_at=2026-06-04T11:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858017962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=657ae9de-0ef0-4601-be7f-15217af68852,host='devstack@QuobyteHD#QuobyteHD',id=c975031e-0778-470a-8660-cb9bcc9a6564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5e5404020d4ef690c80500ef080b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:14Z,use_quota=True,user_id='7c68df2f3314437b8f5f2f72dfd08609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad279305-97f4-48f5-9543-e28289c68db8),volume_type_id=ad279305-97f4-48f5-9543-e28289c68db8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Creating volume c975031e-0778-470a-8660-cb9bcc9a6564 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:21:14 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c975031e-0778-470a-8660-cb9bcc9a6564 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:14 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c975031e-0778-470a-8660-cb9bcc9a6564 1073741824 Jun 04 13:21:14 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-efc6117b-c058-46e0-a543-750b9fcf1210 req-5bcfb15d-902a-4909-9994-52407cfa5158 tempest-AttachVolumeTestJSON-1108399174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-208a4dd0-272e-4004-8219-5446902ca5d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '466fedad-66bb-4bfc-ae24-2b02e818b546', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:21:14 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-efc6117b-c058-46e0-a543-750b9fcf1210 req-5bcfb15d-902a-4909-9994-52407cfa5158 tempest-AttachVolumeTestJSON-1108399174 None] attachment_update completed successfully. Jun 04 13:21:15 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c975031e-0778-470a-8660-cb9bcc9a6564 1073741824" returned: 0 in 0.946s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c975031e-0778-470a-8660-cb9bcc9a6564 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:15 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c975031e-0778-470a-8660-cb9bcc9a6564 Jun 04 13:21:15 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:16 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c975031e-0778-470a-8660-cb9bcc9a6564" returned: 0 in 0.659s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:16 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:21:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412b0d30-d95a-4259-b254-1fad1ab1a168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c975031e-0778-470a-8660-cb9bcc9a6564', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da3c1cf-3d0d-499e-9fca-1f7ca0e9baa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:16 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Volume volume-c975031e-0778-470a-8660-cb9bcc9a6564 (c975031e-0778-470a-8660-cb9bcc9a6564): created successfully Jun 04 13:21:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da3c1cf-3d0d-499e-9fca-1f7ca0e9baa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Flow 'volume_create_manager' (8531c2e3-b87b-4ee4-960f-84dc1a8fca40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:16 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c269cd70-8a50-4bb9-8173-b3dd54ede29e tempest-GroupsTest-1490568282 None] Created volume successfully. Jun 04 13:21:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Acquiring lock "cinder-quobyte-c975031e-0778-470a-8660-cb9bcc9a6564" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Lock "cinder-quobyte-c975031e-0778-470a-8660-cb9bcc9a6564" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:18 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ddf513-27da-4041-9125-be29d9776808]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c975031e-0778-470a-8660-cb9bcc9a6564 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:18 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c975031e-0778-470a-8660-cb9bcc9a6564 Jun 04 13:21:18 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:19 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c975031e-0778-470a-8660-cb9bcc9a6564" returned: 0 in 1.404s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c975031e-0778-470a-8660-cb9bcc9a6564 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:19 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c975031e-0778-470a-8660-cb9bcc9a6564 Jun 04 13:21:19 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:20 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c975031e-0778-470a-8660-cb9bcc9a6564" returned: 0 in 0.773s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Lock "cinder-quobyte-c975031e-0778-470a-8660-cb9bcc9a6564" released by "delete_volume" :: held 2.234s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:20 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Created reservations ['a51a1c09-f0e6-4d5d-9d5a-d93ceb3ad5a4'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:21:20 devstack cinder-volume[86722]: WARNING cinder.quota [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1036405365 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1036405365, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:21:20 devstack cinder-volume[86722]: WARNING cinder.quota [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1036405365 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1036405365, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:21:20 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Created reservations ['e7feb637-ce34-420b-a820-9e377219e7ea', 'f586ea0d-51c9-4855-8904-cb80e08452c7', 'ff0519df-fae3-435f-b76a-8934a899344f', '72e76870-9987-4140-a4ec-77a0002d7c13'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:21:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:20 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:21:20 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:21 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.879s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:21 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:21:21 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-3c69d276-cda3-4d31-9481-5427c67de5d0 tempest-GroupsTest-1490568282 None] Delete group completed successfully. Jun 04 13:21:21 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-20ee7ab5-2e50-4b44-abcf-78974dbbeea7 tempest-GroupsTest-1490568282 None] Created reservations ['21170d2b-8f45-461e-9fdb-e5a14e58234b'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:21:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-20ee7ab5-2e50-4b44-abcf-78974dbbeea7 tempest-GroupsTest-1490568282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-20ee7ab5-2e50-4b44-abcf-78974dbbeea7 tempest-GroupsTest-1490568282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-20ee7ab5-2e50-4b44-abcf-78974dbbeea7 tempest-GroupsTest-1490568282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-20ee7ab5-2e50-4b44-abcf-78974dbbeea7 tempest-GroupsTest-1490568282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-20ee7ab5-2e50-4b44-abcf-78974dbbeea7 tempest-GroupsTest-1490568282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-20ee7ab5-2e50-4b44-abcf-78974dbbeea7 tempest-GroupsTest-1490568282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:21 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:21:21 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:22 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-20ee7ab5-2e50-4b44-abcf-78974dbbeea7 tempest-GroupsTest-1490568282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.822s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:22 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-20ee7ab5-2e50-4b44-abcf-78974dbbeea7 tempest-GroupsTest-1490568282 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:21:22 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-20ee7ab5-2e50-4b44-abcf-78974dbbeea7 tempest-GroupsTest-1490568282 None] Delete group completed successfully. Jun 04 13:21:22 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-77f235ec-2626-4fbe-bffd-ab68c3b5c7bc req-bb5e289f-1577-4d22-aff9-f142b6e399f3 tempest-AttachVolumeTestJSON-1108399174 None] Terminate volume connection completed successfully. Jun 04 13:21:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-77f235ec-2626-4fbe-bffd-ab68c3b5c7bc req-bb5e289f-1577-4d22-aff9-f142b6e399f3 tempest-AttachVolumeTestJSON-1108399174 None] Deleting attachment 6ad51e62-5825-4f3f-a6b8-53460c344f28. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:21:23 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-66f68f48-95a3-4aaf-a141-1916bda6e743 tempest-GroupsTest-1490568282 None] Group tempest-GroupsTest-Group-906784343: creating Jun 04 13:21:23 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-66f68f48-95a3-4aaf-a141-1916bda6e743 tempest-GroupsTest-1490568282 None] Group tempest-GroupsTest-Group-906784343: created successfully Jun 04 13:21:23 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-66f68f48-95a3-4aaf-a141-1916bda6e743 tempest-GroupsTest-1490568282 None] Create group completed successfully. Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Flow 'volume_create_manager' (02de70a3-68d6-48fa-af33-5ff20c392bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03488734-ae90-4854-a453-faed34f254c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03488734-ae90-4854-a453-faed34f254c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695796763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93d96d0c-91d8-42d9-b598-75b360456200,host='devstack@QuobyteHD#QuobyteHD',id=744c83dc-ced0-413b-b0f5-12c0ea89b345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5e5404020d4ef690c80500ef080b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:25Z,use_quota=True,user_id='7c68df2f3314437b8f5f2f72dfd08609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08f4ea63-5862-43d8-95b7-3921ba214c5f),volume_type_id=08f4ea63-5862-43d8-95b7-3921ba214c5f)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f290e10-b658-403d-b4e4-6a7fad520fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f290e10-b658-403d-b4e4-6a7fad520fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5d87a3-4d80-40a4-9c34-90fd80d039c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5d87a3-4d80-40a4-9c34-90fd80d039c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '744c83dc-ced0-413b-b0f5-12c0ea89b345', 'volume_name': 'volume-744c83dc-ced0-413b-b0f5-12c0ea89b345', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647e25be-6a58-48eb-8b42-c4fdbba44805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (647e25be-6a58-48eb-8b42-c4fdbba44805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9663591b-f1e9-4857-a5a8-e7ac4b61ca5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:25 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Volume 744c83dc-ced0-413b-b0f5-12c0ea89b345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-744c83dc-ced0-413b-b0f5-12c0ea89b345', 'volume_size': 1} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=93d96d0c-91d8-42d9-b598-75b360456200,created_at=2026-06-04T11:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695796763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93d96d0c-91d8-42d9-b598-75b360456200,host='devstack@QuobyteHD#QuobyteHD',id=744c83dc-ced0-413b-b0f5-12c0ea89b345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5e5404020d4ef690c80500ef080b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:25Z,use_quota=True,user_id='7c68df2f3314437b8f5f2f72dfd08609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08f4ea63-5862-43d8-95b7-3921ba214c5f),volume_type_id=08f4ea63-5862-43d8-95b7-3921ba214c5f)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Creating volume 744c83dc-ced0-413b-b0f5-12c0ea89b345 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:21:25 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-744c83dc-ced0-413b-b0f5-12c0ea89b345 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:25 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-a5e34365-579d-40f8-86e8-bb8cdf6081c0 req-28cc5f48-7fbf-4d3f-a745-66b98409b510 tempest-AttachVolumeTestJSON-1108399174 None] Terminate volume connection completed successfully. Jun 04 13:21:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a5e34365-579d-40f8-86e8-bb8cdf6081c0 req-28cc5f48-7fbf-4d3f-a745-66b98409b510 tempest-AttachVolumeTestJSON-1108399174 None] Deleting attachment 466fedad-66bb-4bfc-ae24-2b02e818b546. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:21:25 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-744c83dc-ced0-413b-b0f5-12c0ea89b345 1073741824 Jun 04 13:21:25 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:26 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-744c83dc-ced0-413b-b0f5-12c0ea89b345 1073741824" returned: 0 in 1.043s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-744c83dc-ced0-413b-b0f5-12c0ea89b345 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:26 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-744c83dc-ced0-413b-b0f5-12c0ea89b345 Jun 04 13:21:26 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:27 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-744c83dc-ced0-413b-b0f5-12c0ea89b345" returned: 0 in 0.609s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9663591b-f1e9-4857-a5a8-e7ac4b61ca5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-744c83dc-ced0-413b-b0f5-12c0ea89b345', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22946787-20da-498e-86b8-5b4d50df7645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:27 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Volume volume-744c83dc-ced0-413b-b0f5-12c0ea89b345 (744c83dc-ced0-413b-b0f5-12c0ea89b345): created successfully Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22946787-20da-498e-86b8-5b4d50df7645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Flow 'volume_create_manager' (02de70a3-68d6-48fa-af33-5ff20c392bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:27 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ea2a7eab-1ff1-4dcc-a25c-1892b890e8d6 tempest-GroupsTest-1490568282 None] Created volume successfully. Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Flow 'volume_create_manager' (07c1a4b7-63fb-43b7-a9af-f3569eda4b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cec5e47-8674-4ec8-84da-150b13ba4543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cec5e47-8674-4ec8-84da-150b13ba4543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-169012894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19dd3b28-1cf6-4f6f-986d-25b304fcf221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5eb4010013c4087b88e4067bfea3d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:28Z,use_quota=True,user_id='959f0804505a4ba6a7dcb02a827c21d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be9c24c-c0f6-4389-b7b7-13cd252c158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be9c24c-c0f6-4389-b7b7-13cd252c158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04f937b-8ad4-474f-83a5-29eddd090017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04f937b-8ad4-474f-83a5-29eddd090017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19dd3b28-1cf6-4f6f-986d-25b304fcf221', 'volume_name': 'volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59791f9f-48a5-446d-80ae-7a2d9b848a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59791f9f-48a5-446d-80ae-7a2d9b848a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5472ffd-273a-4a02-aec0-317809f2d2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:27 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Volume 19dd3b28-1cf6-4f6f-986d-25b304fcf221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221', 'volume_size': 1} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-169012894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19dd3b28-1cf6-4f6f-986d-25b304fcf221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5eb4010013c4087b88e4067bfea3d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:28Z,use_quota=True,user_id='959f0804505a4ba6a7dcb02a827c21d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Creating volume 19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:21:27 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:21:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:27 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 1073741824 Jun 04 13:21:27 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Flow 'volume_create_manager' (3c99b6b1-5a2f-47d1-a60f-ff0e2d8a1e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a920f427-f308-4c67-b036-cab4b6ed1f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a920f427-f308-4c67-b036-cab4b6ed1f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-501865384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93d96d0c-91d8-42d9-b598-75b360456200,host='devstack@QuobyteHD#QuobyteHD',id=0d707908-00bf-4eec-8843-07d0885792ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5e5404020d4ef690c80500ef080b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:28Z,use_quota=True,user_id='7c68df2f3314437b8f5f2f72dfd08609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08f4ea63-5862-43d8-95b7-3921ba214c5f),volume_type_id=08f4ea63-5862-43d8-95b7-3921ba214c5f)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a338e53e-c43f-4050-a77c-6174ecd97eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a338e53e-c43f-4050-a77c-6174ecd97eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad359cce-86ac-4641-94e4-a0f996866cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad359cce-86ac-4641-94e4-a0f996866cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d707908-00bf-4eec-8843-07d0885792ea', 'volume_name': 'volume-0d707908-00bf-4eec-8843-07d0885792ea', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f41dc2e-e241-48c7-aa7d-3afad9f57433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f41dc2e-e241-48c7-aa7d-3afad9f57433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dea4e7-5fc6-4829-b04f-3cfa119004ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:28 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Volume 0d707908-00bf-4eec-8843-07d0885792ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d707908-00bf-4eec-8843-07d0885792ea', 'volume_size': 1} Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:28 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 1073741824" returned: 0 in 1.073s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:28 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 Jun 04 13:21:28 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:29 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221" returned: 0 in 0.900s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.380s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=93d96d0c-91d8-42d9-b598-75b360456200,created_at=2026-06-04T11:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-501865384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=93d96d0c-91d8-42d9-b598-75b360456200,host='devstack@QuobyteHD#QuobyteHD',id=0d707908-00bf-4eec-8843-07d0885792ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc5e5404020d4ef690c80500ef080b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:28Z,use_quota=True,user_id='7c68df2f3314437b8f5f2f72dfd08609',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08f4ea63-5862-43d8-95b7-3921ba214c5f),volume_type_id=08f4ea63-5862-43d8-95b7-3921ba214c5f)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Creating volume 0d707908-00bf-4eec-8843-07d0885792ea {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:21:29 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0d707908-00bf-4eec-8843-07d0885792ea 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5472ffd-273a-4a02-aec0-317809f2d2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548f2d68-4546-4460-9753-c51253d17802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:29 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0d707908-00bf-4eec-8843-07d0885792ea 1073741824 Jun 04 13:21:29 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:29 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Volume volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 (19dd3b28-1cf6-4f6f-986d-25b304fcf221): created successfully Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548f2d68-4546-4460-9753-c51253d17802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Flow 'volume_create_manager' (07c1a4b7-63fb-43b7-a9af-f3569eda4b8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:30 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-98d092e8-cac7-4b82-b3c0-c5828ef66e8e tempest-SnapshotsActionsTest-2004402507 None] Created volume successfully. Jun 04 13:21:30 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0d707908-00bf-4eec-8843-07d0885792ea 1073741824" returned: 0 in 0.910s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0d707908-00bf-4eec-8843-07d0885792ea {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:30 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0d707908-00bf-4eec-8843-07d0885792ea Jun 04 13:21:30 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:31 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0d707908-00bf-4eec-8843-07d0885792ea" returned: 0 in 0.838s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:21:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.517s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0dea4e7-5fc6-4829-b04f-3cfa119004ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d707908-00bf-4eec-8843-07d0885792ea', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63b2dd1-e985-495e-aa84-ac23aeb87c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] Creating offline snapshot 63093a54-dbd7-4b36-b707-700f09fa788b of volume 19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:21:31 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Volume volume-0d707908-00bf-4eec-8843-07d0885792ea (0d707908-00bf-4eec-8843-07d0885792ea): created successfully Jun 04 13:21:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63b2dd1-e985-495e-aa84-ac23aeb87c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Flow 'volume_create_manager' (3c99b6b1-5a2f-47d1-a60f-ff0e2d8a1e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:31 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe22ad30-6b49-44f7-b196-8b85b51a0476]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:31 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-99f1aba3-5f61-49a6-97ea-fbe31ec2337e tempest-GroupsTest-1490568282 None] Created volume successfully. Jun 04 13:21:31 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 Jun 04 13:21:31 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:32 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221" returned: 0 in 0.784s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:32 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b 1G Jun 04 13:21:32 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:33 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1309bd73-08fb-41ca-a041-c2b9d060da0e tempest-GroupsTest-1490568282 None] Update group completed successfully. Jun 04 13:21:33 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b 1G" returned: 0 in 0.820s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:33 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:21:33 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:33 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 0.631s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:33 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b is being set with open permissions: ugo+rw Jun 04 13:21:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:34 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:21:34 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:34 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-57d73971-ad60-4bf4-87a0-d7a9dd9656eb tempest-GroupsTest-1490568282 None] Update group completed successfully. Jun 04 13:21:34 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 0.578s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:34 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.info Jun 04 13:21:34 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:35 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.info" returned: 0 in 0.601s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:35 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.info is being set with open permissions: ugo+rw Jun 04 13:21:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:35 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.info Jun 04 13:21:35 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Acquiring lock "cinder-quobyte-0d707908-00bf-4eec-8843-07d0885792ea" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Lock "cinder-quobyte-0d707908-00bf-4eec-8843-07d0885792ea" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:35 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce88b208-6097-4d6c-ab26-185229d2fbad]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0d707908-00bf-4eec-8843-07d0885792ea {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:35 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.info" returned: 0 in 0.593s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.140s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:35 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6d84c396-74a6-4c08-86dc-15571df83d28 tempest-SnapshotsActionsTest-2004402507 None] Create snapshot completed successfully Jun 04 13:21:35 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0d707908-00bf-4eec-8843-07d0885792ea Jun 04 13:21:35 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:36 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0d707908-00bf-4eec-8843-07d0885792ea" returned: 0 in 0.755s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0d707908-00bf-4eec-8843-07d0885792ea {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:36 devstack sudo[93058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0d707908-00bf-4eec-8843-07d0885792ea Jun 04 13:21:36 devstack sudo[93058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "cinder-208a4dd0-272e-4004-8219-5446902ca5d2-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Lock "cinder-208a4dd0-272e-4004-8219-5446902ca5d2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "cinder-quobyte-208a4dd0-272e-4004-8219-5446902ca5d2" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Lock "cinder-quobyte-208a4dd0-272e-4004-8219-5446902ca5d2" acquired by "delete_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c6cd0f-bd96-4d39-bfdd-f75ae18e6d48]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] Creating offline snapshot 24708fe6-8407-4188-95c0-fae00444dfc8 of volume 19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[997bfab3-a2d5-4fe0-baa9-0210e6ecbae1]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:37 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2 Jun 04 13:21:37 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:37 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:21:37 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:37 devstack sudo[93058]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0d707908-00bf-4eec-8843-07d0885792ea" returned: 0 in 0.676s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Lock "cinder-quobyte-0d707908-00bf-4eec-8843-07d0885792ea" released by "delete_volume" :: held 1.489s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Acquiring lock "cinder-quobyte-744c83dc-ced0-413b-b0f5-12c0ea89b345" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Lock "cinder-quobyte-744c83dc-ced0-413b-b0f5-12c0ea89b345" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda404e7-db35-4a51-b244-919597113d0f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-744c83dc-ced0-413b-b0f5-12c0ea89b345 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:37 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-744c83dc-ced0-413b-b0f5-12c0ea89b345 Jun 04 13:21:37 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:37 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2" returned: 0 in 0.772s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:37 devstack sudo[93074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2 Jun 04 13:21:37 devstack sudo[93074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:37 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 0.740s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:21:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:37 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 1G Jun 04 13:21:37 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:38 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-744c83dc-ced0-413b-b0f5-12c0ea89b345" returned: 0 in 0.784s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-744c83dc-ced0-413b-b0f5-12c0ea89b345 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:38 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-744c83dc-ced0-413b-b0f5-12c0ea89b345 Jun 04 13:21:38 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:38 devstack sudo[93074]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-208a4dd0-272e-4004-8219-5446902ca5d2" returned: 0 in 0.681s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Lock "cinder-quobyte-208a4dd0-272e-4004-8219-5446902ca5d2" released by "delete_volume" :: held 1.509s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Created reservations ['7387df10-1c3f-4aca-87db-8379133e8a65', 'dbd3eb0f-2464-4ccd-951e-94af5a4885f7', '0201f6e5-69c9-4abd-bdc2-88f25c3e8a7b', 'b918f885-ef28-4ec0-96f3-82f1c915a991'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:38 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:38 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:21:38 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 1G" returned: 0 in 0.812s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:38 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 Jun 04 13:21:38 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:38 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-744c83dc-ced0-413b-b0f5-12c0ea89b345" returned: 0 in 0.642s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Lock "cinder-quobyte-744c83dc-ced0-413b-b0f5-12c0ea89b345" released by "delete_volume" :: held 1.478s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Created reservations ['78d60ffb-fa29-4533-89de-1b227a17a434'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:21:38 devstack cinder-volume[86722]: WARNING cinder.quota [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2020660839 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2020660839, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:21:38 devstack cinder-volume[86722]: WARNING cinder.quota [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2020660839 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2020660839, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Created reservations ['656b6dab-7749-4578-8cf8-037196112a34', '82315f78-f2a9-467a-abd6-6f71e70e03d2', '1dea68c8-1b13-434f-b764-7ea693dae083', '544e9e71-7859-49a9-a479-437c2b866586'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:21:38 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Created reservations ['afbbfa8c-577c-49fc-bf3d-03bc7eb204cd', '1d4b238f-a409-4d67-a77c-b605dcb72164', '851dd27b-4fea-4fbf-b4fa-de3c93563dcd', 'a4211de5-16b8-45cf-a951-c0c071cf9324'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "cinder-b16a034f-7262-4009-80ef-04e82a7094fe-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:39 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.667s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Lock "cinder-b16a034f-7262-4009-80ef-04e82a7094fe-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:39 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:21:39 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Deleted volume successfully. Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0000a39c-25e0-4113-9d4e-ac9f6ef7f210 tempest-AttachVolumeTestJSON-1108399174 None] Lock "cinder-208a4dd0-272e-4004-8219-5446902ca5d2-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "cinder-quobyte-b16a034f-7262-4009-80ef-04e82a7094fe" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Lock "cinder-quobyte-b16a034f-7262-4009-80ef-04e82a7094fe" acquired by "delete_volume" :: waited 0.035s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[0894d491-c98d-4230-b803-cc05d10504b8]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:39 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8" returned: 0 in 0.876s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:39 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 is being set with open permissions: ugo+rw Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:39 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 Jun 04 13:21:39 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:39 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe Jun 04 13:21:39 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:39 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.755s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:39 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:21:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1c2a73a9-e28d-4e46-84f6-be3e3cf91b61 tempest-GroupsTest-1490568282 None] Delete group completed successfully. Jun 04 13:21:40 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8" returned: 0 in 0.678s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.241s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:40 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-2075c699-26e8-4cc9-87d4-42526267dfed tempest-SnapshotsActionsTest-2004402507 None] Create snapshot completed successfully Jun 04 13:21:40 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe" returned: 0 in 0.849s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:40 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe Jun 04 13:21:40 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:40 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b16a034f-7262-4009-80ef-04e82a7094fe" returned: 0 in 0.726s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Lock "cinder-quobyte-b16a034f-7262-4009-80ef-04e82a7094fe" released by "delete_volume" :: held 1.630s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:40 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Created reservations ['b430da7d-eaec-47e9-bc9f-358ed1117091', '8eb0dbeb-e845-4d00-a7e0-d19f670a0e4a', '1eda4fd3-8b08-446c-98dd-e42c547dea38', 'ffbc3d4f-282a-4c95-8a13-4f1a3a45dd28'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:41 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:21:41 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Acquiring lock "cinder-24708fe6-8407-4188-95c0-fae00444dfc8-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-24708fe6-8407-4188-95c0-fae00444dfc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Acquiring lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Acquiring lock "cinder-quobyte-24708fe6-8407-4188-95c0-fae00444dfc8" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-24708fe6-8407-4188-95c0-fae00444dfc8" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Deleting offline snapshot 24708fe6-8407-4188-95c0-fae00444dfc8 of volume 19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] snapshot_file for this snap is: volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d7d373-6854-43eb-9b24-0df804a038e5]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "cinder-7c5a4b80-64dc-4310-bb63-65a2b2667836-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:41 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Lock "cinder-7c5a4b80-64dc-4310-bb63-65a2b2667836-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:41 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=98,cinder:SELECT=106,cinder:DELETE=8,cinder:INSERT=20 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "cinder-quobyte-7c5a4b80-64dc-4310-bb63-65a2b2667836" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Lock "cinder-quobyte-7c5a4b80-64dc-4310-bb63-65a2b2667836" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40866a7-a6d1-416c-827e-3b895ad26fca]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:42 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836 Jun 04 13:21:42 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:42 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.192s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:42 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:21:42 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Deleted volume successfully. Jun 04 13:21:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c90198d0-4429-4fcb-a52a-e2a66159c7eb tempest-AttachVolumeTestJSON-1108399174 None] Lock "cinder-b16a034f-7262-4009-80ef-04e82a7094fe-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:42 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8" returned: 0 in 1.217s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:21:42 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f2bc06-ec01-49dc-a9dc-ceb4559a7ca4]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:42 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:21:42 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:43 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836" returned: 0 in 1.144s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:43 devstack sudo[93143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836 Jun 04 13:21:43 devstack sudo[93143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:43 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 0.811s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:43 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 Jun 04 13:21:43 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:43 devstack sudo[93143]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-7c5a4b80-64dc-4310-bb63-65a2b2667836" returned: 0 in 0.621s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Lock "cinder-quobyte-7c5a4b80-64dc-4310-bb63-65a2b2667836" released by "delete_volume" :: held 1.825s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Created reservations ['69edfe90-c1ed-459c-9d53-ea7d9925ae66', '96bb216f-0f71-4efa-b409-acd03b0cfed5', '87db7030-5d17-4e37-9233-ab67a52947ac', 'f01874b1-5987-47bf-b153-47987f27a69f'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:43 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:21:43 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:44 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8" returned: 0 in 0.910s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:44 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8 Jun 04 13:21:44 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:44 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.868s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:44 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:21:44 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Deleted volume successfully. Jun 04 13:21:44 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ab23974f-3247-42cd-8e9d-1410489d1d3e tempest-AttachVolumeTestJSON-1108399174 None] Lock "cinder-7c5a4b80-64dc-4310-bb63-65a2b2667836-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:44 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:21:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Flow 'volume_create_manager' (309366ec-fa9b-4aaf-9bbd-5676a526dd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd24ddf2-8ad9-4546-a122-b96cec9f3c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd24ddf2-8ad9-4546-a122-b96cec9f3c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1306267150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276010a7-7665-4449-9a34-76e4a0dd41a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a55391ec259488989424dcf975c4637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:45Z,use_quota=True,user_id='94554519f1e4483ab6496aceb19988ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b5f77f-5a85-462d-adb4-67feb115218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b5f77f-5a85-462d-adb4-67feb115218c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7debb0-4825-4972-85f4-c00c3a5a2619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7debb0-4825-4972-85f4-c00c3a5a2619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276010a7-7665-4449-9a34-76e4a0dd41a0', 'volume_name': 'volume-276010a7-7665-4449-9a34-76e4a0dd41a0', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de919102-319a-4c99-addf-ba5beeff91c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de919102-319a-4c99-addf-ba5beeff91c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2159d131-9ddf-44c5-a697-9de1b00d0e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:45 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Volume 276010a7-7665-4449-9a34-76e4a0dd41a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276010a7-7665-4449-9a34-76e4a0dd41a0', 'volume_size': 1} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1306267150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276010a7-7665-4449-9a34-76e4a0dd41a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a55391ec259488989424dcf975c4637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:45Z,use_quota=True,user_id='94554519f1e4483ab6496aceb19988ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Creating volume 276010a7-7665-4449-9a34-76e4a0dd41a0 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:21:45 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-276010a7-7665-4449-9a34-76e4a0dd41a0 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:45 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-276010a7-7665-4449-9a34-76e4a0dd41a0 1073741824 Jun 04 13:21:45 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:45 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.24708fe6-8407-4188-95c0-fae00444dfc8" returned: 0 in 0.966s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-24708fe6-8407-4188-95c0-fae00444dfc8" released by "_delete_snapshot" :: held 4.059s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" released by "delete_snapshot" :: held 4.106s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Created reservations ['91968af9-bfa6-4930-8aa7-d5b68102647d', '626a17fb-067c-4883-827a-b6033b0dfa0d', 'ea105503-e0cf-414a-86a6-16bd43b4cde2', 'd6b66e17-3b85-4b6c-a5d2-1822f59bd83a'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:21:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Delete snapshot completed successfully. Jun 04 13:21:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4f4ab5f4-7d7a-461d-b8ed-0ee2d53d3d55 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-24708fe6-8407-4188-95c0-fae00444dfc8-delete_snapshot" released by "delete_snapshot" :: held 4.303s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-769dc060-e0cc-4995-8aec-40114632e33e tempest-GroupsV314Test-328527682 None] Group tempest-GroupsV314Test-Group-2074874132: creating Jun 04 13:21:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-769dc060-e0cc-4995-8aec-40114632e33e tempest-GroupsV314Test-328527682 None] Group tempest-GroupsV314Test-Group-2074874132: created successfully Jun 04 13:21:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-769dc060-e0cc-4995-8aec-40114632e33e tempest-GroupsV314Test-328527682 None] Create group completed successfully. Jun 04 13:21:46 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-276010a7-7665-4449-9a34-76e4a0dd41a0 1073741824" returned: 0 in 0.991s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-276010a7-7665-4449-9a34-76e4a0dd41a0 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:46 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-276010a7-7665-4449-9a34-76e4a0dd41a0 Jun 04 13:21:46 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:46 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-276010a7-7665-4449-9a34-76e4a0dd41a0" returned: 0 in 0.605s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.569s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] Creating offline snapshot f6057882-fe61-48ca-9c29-a2e605cd4b83 of volume 19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2159d131-9ddf-44c5-a697-9de1b00d0e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276010a7-7665-4449-9a34-76e4a0dd41a0', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d61e11-9fec-4389-b2e4-f40bae2c324b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f80d89-0430-4e6f-807e-1c061e77acc5]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:46 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Volume volume-276010a7-7665-4449-9a34-76e4a0dd41a0 (276010a7-7665-4449-9a34-76e4a0dd41a0): created successfully Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d61e11-9fec-4389-b2e4-f40bae2c324b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Flow 'volume_create_manager' (309366ec-fa9b-4aaf-9bbd-5676a526dd46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:46 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-87e6b6df-8133-41bd-a6dd-bf3400282731 tempest-AttachVolumeShelveTestJSON-1481835787 None] Created volume successfully. Jun 04 13:21:46 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:21:46 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Flow 'volume_create_manager' (ed011e91-2b6e-4602-9743-424a503e2cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a7dcdb-a0fd-4663-a4e2-31a24748c146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a7dcdb-a0fd-4663-a4e2-31a24748c146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-896536547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ed66718-9db7-400f-ad6d-f660be28415d,host='devstack@QuobyteHD#QuobyteHD',id=69493e3c-b7b4-44b3-99f5-ee9ca550577e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52778c1ba29b4b1a90560cfb9a7995da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:47Z,use_quota=True,user_id='4db4d65d2d0447e1a8cdc106481b5091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c175e55-5f5f-4115-b29c-255c5ced7bd0),volume_type_id=8c175e55-5f5f-4115-b29c-255c5ced7bd0)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de714f8a-d262-41c8-8aa1-b9eeb732defe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de714f8a-d262-41c8-8aa1-b9eeb732defe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f674bba-903c-4a55-88fc-f3c7bbaef7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f674bba-903c-4a55-88fc-f3c7bbaef7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69493e3c-b7b4-44b3-99f5-ee9ca550577e', 'volume_name': 'volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7b5914-d689-4ff2-bea4-8beb931723f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7b5914-d689-4ff2-bea4-8beb931723f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d03dfb6-4105-4188-a91b-d5ebd2305737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:47 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Volume 69493e3c-b7b4-44b3-99f5-ee9ca550577e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e', 'volume_size': 1} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:47 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 0.949s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:21:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:47 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 1G Jun 04 13:21:47 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:48 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 1G" returned: 0 in 1.069s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:48 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 Jun 04 13:21:48 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:49 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83" returned: 0 in 0.683s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:49 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 is being set with open permissions: ugo+rw Jun 04 13:21:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:49 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 Jun 04 13:21:49 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:50 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83" returned: 0 in 0.684s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.570s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.720s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7ed66718-9db7-400f-ad6d-f660be28415d,created_at=2026-06-04T11:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-896536547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ed66718-9db7-400f-ad6d-f660be28415d,host='devstack@QuobyteHD#QuobyteHD',id=69493e3c-b7b4-44b3-99f5-ee9ca550577e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52778c1ba29b4b1a90560cfb9a7995da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:47Z,use_quota=True,user_id='4db4d65d2d0447e1a8cdc106481b5091',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8c175e55-5f5f-4115-b29c-255c5ced7bd0),volume_type_id=8c175e55-5f5f-4115-b29c-255c5ced7bd0)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:21:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Creating volume 69493e3c-b7b4-44b3-99f5-ee9ca550577e {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:21:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:21:50 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:21:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:50 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e 1073741824 Jun 04 13:21:50 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:50 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6305d176-b235-46c1-9488-4d817372c0b9 tempest-SnapshotsActionsTest-2004402507 None] Create snapshot completed successfully Jun 04 13:21:51 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e 1073741824" returned: 0 in 0.932s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:51 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e Jun 04 13:21:51 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Acquiring lock "cinder-f6057882-fe61-48ca-9c29-a2e605cd4b83-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-f6057882-fe61-48ca-9c29-a2e605cd4b83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Acquiring lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Acquiring lock "cinder-quobyte-f6057882-fe61-48ca-9c29-a2e605cd4b83" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-f6057882-fe61-48ca-9c29-a2e605cd4b83" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Deleting offline snapshot f6057882-fe61-48ca-9c29-a2e605cd4b83 of volume 19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] snapshot_file for this snap is: volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd27e49c-1bca-4ef0-9adc-58781d6093da]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:51 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 Jun 04 13:21:51 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:51 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e" returned: 0 in 0.638s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d03dfb6-4105-4188-a91b-d5ebd2305737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b11d5e-c21f-404a-b37b-795105e898bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:51 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Volume volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e (69493e3c-b7b4-44b3-99f5-ee9ca550577e): created successfully Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b11d5e-c21f-404a-b37b-795105e898bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Flow 'volume_create_manager' (ed011e91-2b6e-4602-9743-424a503e2cb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:52 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-4b7ba84e-f182-412d-8f50-cff045d6670f tempest-GroupsV314Test-328527682 None] Created volume successfully. Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Flow 'volume_create_manager' (d254e2a2-3e77-4d4d-8c4e-ef68fd66538d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f083d787-1f98-4e80-bbbe-65138a81e897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f083d787-1f98-4e80-bbbe-65138a81e897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2029787155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb89304a-8d76-4da4-b19c-3bfbd3e768d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='193f69ae83fb482299163d3c9011cab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:52Z,use_quota=True,user_id='48330865a9cf45479d8ea36878b61ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0867bc8-9a79-46f0-be12-faa601704b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0867bc8-9a79-46f0-be12-faa601704b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4b3837-9802-41f7-892e-b669c54318ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4b3837-9802-41f7-892e-b669c54318ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb89304a-8d76-4da4-b19c-3bfbd3e768d7', 'volume_name': 'volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7d8fe0-32a9-4ce8-aa14-437de3ec5728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7d8fe0-32a9-4ce8-aa14-437de3ec5728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7391ed-db55-4438-81b7-19f39345b8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:52 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Volume cb89304a-8d76-4da4-b19c-3bfbd3e768d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7', 'volume_size': 1} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2029787155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb89304a-8d76-4da4-b19c-3bfbd3e768d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='193f69ae83fb482299163d3c9011cab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:21:52Z,use_quota=True,user_id='48330865a9cf45479d8ea36878b61ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Creating volume cb89304a-8d76-4da4-b19c-3bfbd3e768d7 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:21:52 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:52 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7 1073741824 Jun 04 13:21:52 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:52 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83" returned: 0 in 0.797s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd43fd2-707b-405d-88c5-0bb98af40b71]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:52 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:21:52 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:52 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7 1073741824" returned: 0 in 0.845s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:53 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7 Jun 04 13:21:53 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:53 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 0.794s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:21:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:53 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 Jun 04 13:21:53 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:53 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7" returned: 0 in 0.652s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:21:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7391ed-db55-4438-81b7-19f39345b8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fa4b73-5f23-4732-9611-d2404862a909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:21:53 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Volume volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7 (cb89304a-8d76-4da4-b19c-3bfbd3e768d7): created successfully Jun 04 13:21:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fa4b73-5f23-4732-9611-d2404862a909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:21:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Flow 'volume_create_manager' (d254e2a2-3e77-4d4d-8c4e-ef68fd66538d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:21:53 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-69df3c98-d418-4bbc-aa67-995e9f1c0a16 req-c55652d9-adb0-4551-ba95-8d7b40e630f1 tempest-VolumesGetTestJSON-1609359245 None] Created volume successfully. Jun 04 13:21:54 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83" returned: 0 in 0.816s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=126,cinder:SELECT=110,cinder:INSERT=23,cinder:DELETE=6 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:21:54 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83 Jun 04 13:21:54 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:54 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Cloning volume 69493e3c-b7b4-44b3-99f5-ee9ca550577e to volume 5f37167a-9f00-4305-bcac-9f31630a9381 Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Creating offline snapshot 62d54e83-48a4-4cec-ac29-eafbd2586113 of volume 69493e3c-b7b4-44b3-99f5-ee9ca550577e {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[8439456a-f316-4834-a5f6-a1de084feddc]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:54 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e Jun 04 13:21:54 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Acquiring lock "cinder-cb89304a-8d76-4da4-b19c-3bfbd3e768d7-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Lock "cinder-cb89304a-8d76-4da4-b19c-3bfbd3e768d7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Acquiring lock "cinder-quobyte-cb89304a-8d76-4da4-b19c-3bfbd3e768d7" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Lock "cinder-quobyte-cb89304a-8d76-4da4-b19c-3bfbd3e768d7" acquired by "delete_volume" :: waited 0.026s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[504d0391-585a-4e48-a77e-e1f07806afaa]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:54 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7 Jun 04 13:21:54 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:54 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.f6057882-fe61-48ca-9c29-a2e605cd4b83" returned: 0 in 0.765s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-f6057882-fe61-48ca-9c29-a2e605cd4b83" released by "_delete_snapshot" :: held 3.294s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" released by "delete_snapshot" :: held 3.324s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:55 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Created reservations ['d96ae929-e82f-43ec-9143-723918673ac3', 'f984c9ea-b48f-4e8b-a36b-d75ec7d71e4e', 'd0d12851-a7f5-4d96-9fac-0171b6b68057', '72f897fb-7bfb-4376-ac45-87ff995ba1c0'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:21:55 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Delete snapshot completed successfully. Jun 04 13:21:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0c1698f5-1b17-45fe-9bb9-8fc06e02c1c2 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-f6057882-fe61-48ca-9c29-a2e605cd4b83-delete_snapshot" released by "delete_snapshot" :: held 3.495s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:55 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e" returned: 0 in 0.914s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:55 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 1G Jun 04 13:21:55 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:55 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7" returned: 0 in 0.912s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:55 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7 Jun 04 13:21:55 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:56 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 1G" returned: 0 in 0.917s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:56 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 Jun 04 13:21:56 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:56 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cb89304a-8d76-4da4-b19c-3bfbd3e768d7" returned: 0 in 0.794s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Lock "cinder-quobyte-cb89304a-8d76-4da4-b19c-3bfbd3e768d7" released by "delete_volume" :: held 1.773s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG cinder.quota [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Created reservations ['3388e2d3-f7c3-4eb3-ae26-bf0862f83802', 'fe5758eb-19d9-4691-b7a6-6ebb811c1ef7', '1d874af1-40e7-478a-a387-236ef30a203d', 'cc290a53-37e4-494c-a03c-81026df8560a'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:56 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:21:56 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:56 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113" returned: 0 in 0.738s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:56 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:21:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:56 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 Jun 04 13:21:56 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:57 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.632s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:57 devstack cinder-volume[86722]: DEBUG cinder.manager [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:21:57 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Deleted volume successfully. Jun 04 13:21:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-474cff2e-c319-48e8-abee-5a78dba93bc3 req-3e8dc30e-00b0-4c89-874f-54c52bd26ee0 tempest-VolumesGetTestJSON-1609359245 None] Lock "cinder-cb89304a-8d76-4da4-b19c-3bfbd3e768d7-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:21:57 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113" returned: 0 in 0.629s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:57 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.info Jun 04 13:21:57 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:58 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.info" returned: 0 in 0.656s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:58 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:58 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.info Jun 04 13:21:58 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:58 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.info" returned: 0 in 0.664s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Acquiring lock "cinder-quobyte-5f37167a-9f00-4305-bcac-9f31630a9381" by "_copy_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Lock "cinder-quobyte-5f37167a-9f00-4305-bcac-9f31630a9381" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] snapshot: 62d54e83-48a4-4cec-ac29-eafbd2586113, volume: 5f37167a-9f00-4305-bcac-9f31630a9381, {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d06c0f-2874-47b2-837b-a732faffd0d0]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:59 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 Jun 04 13:21:59 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:21:59 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Jun 04 13:21:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113" returned: 0 in 0.842s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:21:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:21:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 13:21:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Creating direct copy from snapshot {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 13:21:59 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47825dc-aaca-41aa-a637-f66f14ccc3ca]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:21:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:21:59 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e Jun 04 13:21:59 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:00 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e" returned: 0 in 0.833s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:00 devstack cinder-volume[86722]: DEBUG cinder.utils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Path /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381 not found in is_blk_device check {{(pid=86722) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 13:22:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:00 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381 Jun 04 13:22:00 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:01 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:22:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Flow 'volume_create_manager' (fafbd040-8c43-4849-934f-ab4184af9f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:22:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b157cba6-c49b-443b-9e21-4bf2b0a18c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b157cba6-c49b-443b-9e21-4bf2b0a18c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1427238875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3bd5172-213b-47b8-a6cd-802c95bac0ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c03cd2f2b1430498077582058a0cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:22:01Z,use_quota=True,user_id='12e6b53272524b258e7ba0ab98e906eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5499cc3b-1d22-4722-bd2e-a219e2da87b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5499cc3b-1d22-4722-bd2e-a219e2da87b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9981f4-905e-4f74-ab38-e1f05366d34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9981f4-905e-4f74-ab38-e1f05366d34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3bd5172-213b-47b8-a6cd-802c95bac0ba', 'volume_name': 'volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ecdb1b-90a6-4a9c-8714-32fac2cb1702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ecdb1b-90a6-4a9c-8714-32fac2cb1702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0da82d-897b-4dc6-b935-fbd95d2df049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:01 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Volume c3bd5172-213b-47b8-a6cd-802c95bac0ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba', 'volume_size': 1} Jun 04 13:22:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:22:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:22:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:22:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:04 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:22:04 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-07294234-9b34-4c54-9479-902ac38cad5b req-43073ff4-034f-44b3-a5f0-08fe424d2655 tempest-AttachVolumeShelveTestJSON-1481835787 None] No connector for attachment 4fcb10ca-9601-4446-9ea8-b075bfd11e7a; skipping storage backend terminate_connection call. {{(pid=86722) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5011}} Jun 04 13:22:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-07294234-9b34-4c54-9479-902ac38cad5b req-43073ff4-034f-44b3-a5f0-08fe424d2655 tempest-AttachVolumeShelveTestJSON-1481835787 None] Deleting attachment 4fcb10ca-9601-4446-9ea8-b075bfd11e7a. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:22:06 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 2.057s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:06 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:22:06 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:22:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 8 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:22:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:22:06 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381" returned: 0 in 5.598s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:06 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[350dbd8e-4b21-477d-a8af-37c20fb6e906]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:06 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e Jun 04 13:22:06 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:07 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e" returned: 0 in 0.887s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:07 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381 {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:22:07 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Converted 1024.00 MB image at 182.81 MB/s Jun 04 13:22:07 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:22:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:07 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381 Jun 04 13:22:07 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:07 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381" returned: 0 in 0.594s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Lock "cinder-quobyte-5f37167a-9f00-4305-bcac-9f31630a9381" released by "_copy_volume_from_snapshot" :: held 8.862s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Acquiring lock "cinder-quobyte-62d54e83-48a4-4cec-ac29-eafbd2586113" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Lock "cinder-quobyte-62d54e83-48a4-4cec-ac29-eafbd2586113" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Deleting offline snapshot 62d54e83-48a4-4cec-ac29-eafbd2586113 of volume 69493e3c-b7b4-44b3-99f5-ee9ca550577e {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:22:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] snapshot_file for this snap is: volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:22:07 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed326dc2-666f-400e-81af-cb944b0f9694]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:07 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 Jun 04 13:22:07 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:08 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113" returned: 0 in 0.734s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:22:08 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed432997-81ae-4600-a490-eb31ea6a77fd]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:08 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e Jun 04 13:22:08 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:09 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e" returned: 0 in 0.702s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:09 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 Jun 04 13:22:09 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:09 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113" returned: 0 in 0.673s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:09 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113 Jun 04 13:22:09 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:10 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e.62d54e83-48a4-4cec-ac29-eafbd2586113" returned: 0 in 0.589s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:10 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Lock "cinder-quobyte-62d54e83-48a4-4cec-ac29-eafbd2586113" released by "_delete_snapshot" :: held 2.794s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.354s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.334s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:10 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] Creating offline snapshot 809c4a39-2ee1-416c-b38f-17bca8222eb7 of volume 19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:22:10 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cac5f89-cc6b-4dbc-a7fb-b67428d0bff4]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:10 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f08f8fd1-a7ad-4b00-b2a3-c93ff86ff200 tempest-GroupsV314Test-328527682 None] Create group from source-group-7ed66718-9db7-400f-ad6d-f660be28415d completed successfully. Jun 04 13:22:10 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:22:10 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:11 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 0.697s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:22:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:11 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 1G Jun 04 13:22:11 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:11 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Acquiring lock "cinder-quobyte-5f37167a-9f00-4305-bcac-9f31630a9381" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:11 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Lock "cinder-quobyte-5f37167a-9f00-4305-bcac-9f31630a9381" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:11 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b5deea-1172-4789-94e1-3750a3ff65b0]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:12 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381 Jun 04 13:22:12 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:12 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 1G" returned: 0 in 0.974s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:12 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 Jun 04 13:22:12 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:12 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381" returned: 0 in 0.895s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:12 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381 Jun 04 13:22:12 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:13 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7" returned: 0 in 0.741s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:13 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 is being set with open permissions: ugo+rw Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:13 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 Jun 04 13:22:13 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:13 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f37167a-9f00-4305-bcac-9f31630a9381" returned: 0 in 0.642s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Lock "cinder-quobyte-5f37167a-9f00-4305-bcac-9f31630a9381" released by "delete_volume" :: held 1.592s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Created reservations ['56a01acf-7027-4c39-9e4a-c2757fb8122b'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:13 devstack cinder-volume[86722]: WARNING cinder.quota [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1164789933 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1164789933, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:22:13 devstack cinder-volume[86722]: WARNING cinder.quota [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1164789933 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1164789933, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Created reservations ['c9221927-ccf8-4168-9a90-da4f75f1ef99', '12886e94-ccbf-46f9-b89b-14f6d92c576e', 'ea029549-2345-463e-9834-5a99f3ed551c', 'f574c0e7-cf16-4e94-9621-41abef7841bd'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:13 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7" returned: 0 in 0.620s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.152s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.488s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1427238875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3bd5172-213b-47b8-a6cd-802c95bac0ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c03cd2f2b1430498077582058a0cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:22:01Z,use_quota=True,user_id='12e6b53272524b258e7ba0ab98e906eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Creating volume c3bd5172-213b-47b8-a6cd-802c95bac0ba {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:22:13 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:13 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba 1073741824 Jun 04 13:22:13 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:13 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f76b6ad6-3f1f-4676-a95d-ab5c5286266c tempest-SnapshotsActionsTest-2004402507 None] Create snapshot completed successfully Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:13 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:22:13 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Acquiring lock "cinder-quobyte-69493e3c-b7b4-44b3-99f5-ee9ca550577e" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Acquiring lock "cinder-809c4a39-2ee1-416c-b38f-17bca8222eb7-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Lock "cinder-quobyte-69493e3c-b7b4-44b3-99f5-ee9ca550577e" acquired by "delete_volume" :: waited 0.030s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c776c7f-bb8e-42ab-9f30-0c3b1399f037]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-809c4a39-2ee1-416c-b38f-17bca8222eb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Acquiring lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Acquiring lock "cinder-quobyte-809c4a39-2ee1-416c-b38f-17bca8222eb7" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-809c4a39-2ee1-416c-b38f-17bca8222eb7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Deleting offline snapshot 809c4a39-2ee1-416c-b38f-17bca8222eb7 of volume 19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] snapshot_file for this snap is: volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:22:14 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f2a97a-a664-4ae6-b271-3a2cee6d9f84]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.741s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:22:14 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c0db795b-ec73-4a9d-8dbe-75f3fbd0620a tempest-GroupsV314Test-328527682 None] Delete group completed successfully. Jun 04 13:22:14 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e Jun 04 13:22:14 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:14 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba 1073741824" returned: 0 in 0.906s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:14 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 Jun 04 13:22:14 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:14 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba Jun 04 13:22:14 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:15 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e" returned: 0 in 1.035s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:15 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e Jun 04 13:22:15 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:15 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba" returned: 0 in 0.946s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0da82d-897b-4dc6-b935-fbd95d2df049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aca2abc-245f-4286-a1cb-4a618f4c38b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:15 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Volume volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba (c3bd5172-213b-47b8-a6cd-802c95bac0ba): created successfully Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aca2abc-245f-4286-a1cb-4a618f4c38b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Flow 'volume_create_manager' (fafbd040-8c43-4849-934f-ab4184af9f80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:22:15 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-823ebf38-07ea-46e6-a1c4-832bb3297141 tempest-VolumesServicesTestJSON-876317435 None] Created volume successfully. Jun 04 13:22:15 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7" returned: 0 in 1.175s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[186b0acd-45d0-44ef-835a-9bf964c2ac3c]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:15 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:22:15 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:16 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-69493e3c-b7b4-44b3-99f5-ee9ca550577e" returned: 0 in 0.695s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Lock "cinder-quobyte-69493e3c-b7b4-44b3-99f5-ee9ca550577e" released by "delete_volume" :: held 1.812s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Created reservations ['a5b9b305-8d9d-465e-be1d-465a60233ca5'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Created reservations ['ba9358e6-61d4-4868-ab6a-84b87d83c0df', '0e1ffb68-dcc0-4b54-9f28-b4f2e51fe2d5', '4575a3ad-2808-40f6-ac9b-6790867866b3', '83f9a034-5e79-4a52-906a-f7e786b52e86'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:16 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 0.906s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:16 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:22:16 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:16 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 Jun 04 13:22:16 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Acquiring lock "cinder-c3bd5172-213b-47b8-a6cd-802c95bac0ba-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Lock "cinder-c3bd5172-213b-47b8-a6cd-802c95bac0ba-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Acquiring lock "cinder-quobyte-c3bd5172-213b-47b8-a6cd-802c95bac0ba" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Lock "cinder-quobyte-c3bd5172-213b-47b8-a6cd-802c95bac0ba" acquired by "delete_volume" :: waited 0.036s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7da9c62-1730-4930-adbc-d41c7a953254]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:17 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba Jun 04 13:22:17 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:17 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.881s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:17 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:22:17 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e3c1da69-414d-41f9-84a7-dcf42057706f tempest-GroupsV314Test-328527682 None] Delete group completed successfully. Jun 04 13:22:17 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7" returned: 0 in 1.038s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:17 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7 Jun 04 13:22:17 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:17 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba" returned: 0 in 0.881s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:17 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba Jun 04 13:22:17 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:18 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.809c4a39-2ee1-416c-b38f-17bca8222eb7" returned: 0 in 0.665s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-809c4a39-2ee1-416c-b38f-17bca8222eb7" released by "_delete_snapshot" :: held 3.911s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" released by "delete_snapshot" :: held 3.940s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Created reservations ['8584e1bc-fae6-47b2-b9fe-a7894278a17b', '5d514ef7-5743-4592-aabc-f159ea4826d9', 'fac4e915-baf3-4c7d-9ce1-e589126d4215', 'ef22c475-e611-4a29-89cb-b7441411025f'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:18 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Delete snapshot completed successfully. Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-56566641-e152-4e0b-81ca-9badee725506 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-809c4a39-2ee1-416c-b38f-17bca8222eb7-delete_snapshot" released by "delete_snapshot" :: held 4.143s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:18 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c3bd5172-213b-47b8-a6cd-802c95bac0ba" returned: 0 in 0.757s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Lock "cinder-quobyte-c3bd5172-213b-47b8-a6cd-802c95bac0ba" released by "delete_volume" :: held 1.706s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Created reservations ['46996cfb-6852-41e8-bf4c-3f1cfca99928', '1666a0d3-dfa7-47ca-b3aa-c835d2d8a060', '212e75c0-699d-4524-8056-8b019653df50', '75a119cd-7cf8-4227-bd31-be40ec74b15e'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:18 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:22:18 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] Creating offline snapshot 9889a582-7755-4ac8-883d-859eb9aff4ac of volume 19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:22:19 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b538b4f-6fe2-48d7-8418-d08b87fc46e9]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:19 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:22:19 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:19 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.877s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:19 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:22:19 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Deleted volume successfully. Jun 04 13:22:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b53c038c-9fd7-449e-b906-2621e6e517f3 tempest-VolumesServicesTestJSON-876317435 None] Lock "cinder-c3bd5172-213b-47b8-a6cd-802c95bac0ba-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:20 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 0.979s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:22:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:20 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac 1G Jun 04 13:22:20 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:21 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac 1G" returned: 0 in 1.021s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:21 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac Jun 04 13:22:21 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:22 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac" returned: 0 in 0.718s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:22 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac is being set with open permissions: ugo+rw Jun 04 13:22:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:22 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac Jun 04 13:22:22 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:22 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac" returned: 0 in 0.664s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.564s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:22 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-280b0822-411c-42ed-96a2-16547accc694 tempest-SnapshotsActionsTest-2004402507 None] Create snapshot completed successfully Jun 04 13:22:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Acquiring lock "cinder-9889a582-7755-4ac8-883d-859eb9aff4ac-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-9889a582-7755-4ac8-883d-859eb9aff4ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Acquiring lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Acquiring lock "cinder-quobyte-9889a582-7755-4ac8-883d-859eb9aff4ac" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-9889a582-7755-4ac8-883d-859eb9aff4ac" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Deleting offline snapshot 9889a582-7755-4ac8-883d-859eb9aff4ac of volume 19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:22:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] snapshot_file for this snap is: volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:22:23 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9971bf-89f4-4544-9117-2ba83032ac5f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:24 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac Jun 04 13:22:24 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:24 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-96f8389e-cdff-4f99-8256-c3bfdcec7076 tempest-GroupsV320Test-1931853752 None] Group tempest-GroupsV320Test-Group-915643147: creating Jun 04 13:22:24 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-96f8389e-cdff-4f99-8256-c3bfdcec7076 tempest-GroupsV320Test-1931853752 None] Group tempest-GroupsV320Test-Group-915643147: created successfully Jun 04 13:22:24 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-96f8389e-cdff-4f99-8256-c3bfdcec7076 tempest-GroupsV320Test-1931853752 None] Create group completed successfully. Jun 04 13:22:25 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac" returned: 0 in 1.486s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:22:25 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a0c880-2684-40ca-9d2f-0488db904961]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:25 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:22:25 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:26 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 0.983s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:22:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:26 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac Jun 04 13:22:26 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:26 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-41235da0-4a82-4d03-9a4d-6628f75fc465 tempest-GroupsV320Test-1931853752 None] Created reservations ['f35040f7-fae3-41d6-909a-fcb7cbf773c9'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-41235da0-4a82-4d03-9a4d-6628f75fc465 tempest-GroupsV320Test-1931853752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-41235da0-4a82-4d03-9a4d-6628f75fc465 tempest-GroupsV320Test-1931853752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-41235da0-4a82-4d03-9a4d-6628f75fc465 tempest-GroupsV320Test-1931853752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:22:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-41235da0-4a82-4d03-9a4d-6628f75fc465 tempest-GroupsV320Test-1931853752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:22:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-41235da0-4a82-4d03-9a4d-6628f75fc465 tempest-GroupsV320Test-1931853752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41235da0-4a82-4d03-9a4d-6628f75fc465 tempest-GroupsV320Test-1931853752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:26 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:22:26 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:27 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41235da0-4a82-4d03-9a4d-6628f75fc465 tempest-GroupsV320Test-1931853752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.839s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:27 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-41235da0-4a82-4d03-9a4d-6628f75fc465 tempest-GroupsV320Test-1931853752 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:22:27 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-41235da0-4a82-4d03-9a4d-6628f75fc465 tempest-GroupsV320Test-1931853752 None] Delete group completed successfully. Jun 04 13:22:27 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac" returned: 0 in 1.042s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:27 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac Jun 04 13:22:27 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:28 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.9889a582-7755-4ac8-883d-859eb9aff4ac" returned: 0 in 0.816s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:28 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-9889a582-7755-4ac8-883d-859eb9aff4ac" released by "_delete_snapshot" :: held 4.491s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:28 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" released by "delete_snapshot" :: held 4.536s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:28 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Created reservations ['a809b93e-5722-4e30-a78d-a66612be33d9', 'b3918927-c6e6-4c76-83f0-cf03dbbb4ae0', '91bdfca1-69a7-4eba-b452-84ee5792ddf0', '53d028db-ae60-44fb-89c1-509f0835a4a8'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:28 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Delete snapshot completed successfully. Jun 04 13:22:28 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-176356a1-106e-4566-afce-64891a68b619 tempest-SnapshotsActionsTest-34798927 None] Lock "cinder-9889a582-7755-4ac8-883d-859eb9aff4ac-delete_snapshot" released by "delete_snapshot" :: held 4.778s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "cinder-63093a54-dbd7-4b36-b707-700f09fa788b-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Lock "cinder-63093a54-dbd7-4b36-b707-700f09fa788b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "cinder-quobyte-63093a54-dbd7-4b36-b707-700f09fa788b" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Lock "cinder-quobyte-63093a54-dbd7-4b36-b707-700f09fa788b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Deleting offline snapshot 63093a54-dbd7-4b36-b707-700f09fa788b of volume 19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:22:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] snapshot_file for this snap is: volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:22:29 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd51fb4e-885c-4297-88a4-4750c112b2e6]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:29 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:22:29 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:30 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 1.014s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:22:30 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[db23c04f-50c4-49cd-bdc3-e1fa66f0b46d]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:31 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 Jun 04 13:22:31 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:31 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221" returned: 0 in 0.974s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:31 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:22:31 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:32 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 0.898s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:32 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b Jun 04 13:22:32 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:33 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221.63093a54-dbd7-4b36-b707-700f09fa788b" returned: 0 in 0.777s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Lock "cinder-quobyte-63093a54-dbd7-4b36-b707-700f09fa788b" released by "_delete_snapshot" :: held 3.819s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" released by "delete_snapshot" :: held 3.870s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:33 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Created reservations ['9df54999-e872-4713-ad5a-d4c1319f7753', 'dcda18ca-2216-42ed-981f-ef5a28d2754b', '25e1e1d0-44ba-4530-bad5-95eece2b672f', '45c82705-6d21-4556-a5b3-0bb3bd625120'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:33 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Delete snapshot completed successfully. Jun 04 13:22:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff95872d-3a16-4739-bdd1-f41e135e8e84 tempest-SnapshotsActionsTest-2004402507 None] Lock "cinder-63093a54-dbd7-4b36-b707-700f09fa788b-delete_snapshot" released by "delete_snapshot" :: held 4.121s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "cinder-19dd3b28-1cf6-4f6f-986d-25b304fcf221-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Lock "cinder-19dd3b28-1cf6-4f6f-986d-25b304fcf221-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" acquired by "delete_volume" :: waited 0.036s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:34 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed08cc33-cf09-43f1-a03d-3dc3bdc65520]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:34 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 Jun 04 13:22:34 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:35 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221" returned: 0 in 0.739s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:35 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221 Jun 04 13:22:35 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:35 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-19dd3b28-1cf6-4f6f-986d-25b304fcf221" returned: 0 in 0.811s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Lock "cinder-quobyte-19dd3b28-1cf6-4f6f-986d-25b304fcf221" released by "delete_volume" :: held 1.647s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:36 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Created reservations ['30e07aed-c399-4c8d-b5ac-6820d955d3ed', '5661a67c-01a0-4773-9d81-c52c334950de', '08705836-a1c7-4e1b-83c7-9b5e0c3e8960', 'd7a96077-9cec-4770-bc5e-bfdd7b9d0b57'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:22:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:22:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:36 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:22:36 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:37 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.994s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:37 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:22:37 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Deleted volume successfully. Jun 04 13:22:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-aabffe9f-345f-48a1-9d4b-59ab30bda569 tempest-SnapshotsActionsTest-2004402507 None] Lock "cinder-19dd3b28-1cf6-4f6f-986d-25b304fcf221-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=100,cinder:INSERT=27,cinder:UPDATE=99,cinder:DELETE=5 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Flow 'volume_create_manager' (89647040-c5da-4d41-83ce-15eb2f3e1014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4749da01-5ac8-4b43-8183-14dd4dabc937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4749da01-5ac8-4b43-8183-14dd4dabc937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-455429696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47655dac-c17a-4331-85be-de3a42395a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b072954f5d4a4456b66a3c9aaf065e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:22:42Z,use_quota=True,user_id='817f86b05fdd4a05b93b044c5b3cd766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a8da8ed-7e49-4a85-aff1-f35f86f808ee),volume_type_id=9a8da8ed-7e49-4a85-aff1-f35f86f808ee)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6314ae-6322-4f19-a2e6-295e0deea3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af6314ae-6322-4f19-a2e6-295e0deea3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f8c3e5-93bb-48c2-b5c8-abaf80bdf321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f8c3e5-93bb-48c2-b5c8-abaf80bdf321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47655dac-c17a-4331-85be-de3a42395a4d', 'volume_name': 'volume-47655dac-c17a-4331-85be-de3a42395a4d', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e420e3f-4e99-451c-8d84-fa95beb99aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e420e3f-4e99-451c-8d84-fa95beb99aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb33885-e9ac-4673-805f-44039cc7fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:42 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Volume 47655dac-c17a-4331-85be-de3a42395a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47655dac-c17a-4331-85be-de3a42395a4d', 'volume_size': 1} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-455429696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47655dac-c17a-4331-85be-de3a42395a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b072954f5d4a4456b66a3c9aaf065e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:22:42Z,use_quota=True,user_id='817f86b05fdd4a05b93b044c5b3cd766',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a8da8ed-7e49-4a85-aff1-f35f86f808ee),volume_type_id=9a8da8ed-7e49-4a85-aff1-f35f86f808ee)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Creating volume 47655dac-c17a-4331-85be-de3a42395a4d {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:22:42 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:22:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-47655dac-c17a-4331-85be-de3a42395a4d 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:42 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-47655dac-c17a-4331-85be-de3a42395a4d 1073741824 Jun 04 13:22:42 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:43 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-47655dac-c17a-4331-85be-de3a42395a4d 1073741824" returned: 0 in 0.906s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-47655dac-c17a-4331-85be-de3a42395a4d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:43 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-47655dac-c17a-4331-85be-de3a42395a4d Jun 04 13:22:43 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:43 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-47655dac-c17a-4331-85be-de3a42395a4d" returned: 0 in 0.609s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:22:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb33885-e9ac-4673-805f-44039cc7fe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47655dac-c17a-4331-85be-de3a42395a4d', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c7d515-6ae6-41f3-aff4-acdbcc69ba67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:43 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Volume volume-47655dac-c17a-4331-85be-de3a42395a4d (47655dac-c17a-4331-85be-de3a42395a4d): created successfully Jun 04 13:22:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c7d515-6ae6-41f3-aff4-acdbcc69ba67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Flow 'volume_create_manager' (89647040-c5da-4d41-83ce-15eb2f3e1014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:22:44 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6ef55f6c-c670-4bee-9569-de36afbab2ba tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Created volume successfully. Jun 04 13:22:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-89a4f11f-b7a6-4846-9922-3ae7eed8342d tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-89a4f11f-b7a6-4846-9922-3ae7eed8342d tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-89a4f11f-b7a6-4846-9922-3ae7eed8342d tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:22:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-89a4f11f-b7a6-4846-9922-3ae7eed8342d tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:22:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-89a4f11f-b7a6-4846-9922-3ae7eed8342d tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-89a4f11f-b7a6-4846-9922-3ae7eed8342d tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:44 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:22:44 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Flow 'volume_create_manager' (785b2973-d964-46c8-bca2-3ee8efe5bfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d484dd2-3144-4020-91a6-89a09b97377e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d484dd2-3144-4020-91a6-89a09b97377e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-914445520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79ceaba-5f72-4604-ac1f-b8087e9de4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f727458e1d4cbaa6528f3465a7b779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:22:46Z,use_quota=True,user_id='6f52c8fc791f43e8a34ad576e6791ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b0fa99-99e4-4ca2-8c63-f853a0b6fc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b0fa99-99e4-4ca2-8c63-f853a0b6fc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb080fae-9391-433d-a2cb-eed451e03992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb080fae-9391-433d-a2cb-eed451e03992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a79ceaba-5f72-4604-ac1f-b8087e9de4f5', 'volume_name': 'volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21012e2b-9f18-46a5-9552-8734e2981f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21012e2b-9f18-46a5-9552-8734e2981f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754ddfa3-826b-40e7-99d0-32b567024204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:45 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Volume a79ceaba-5f72-4604-ac1f-b8087e9de4f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5', 'volume_size': 1} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-914445520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a79ceaba-5f72-4604-ac1f-b8087e9de4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f727458e1d4cbaa6528f3465a7b779',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:22:46Z,use_quota=True,user_id='6f52c8fc791f43e8a34ad576e6791ade',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Creating volume a79ceaba-5f72-4604-ac1f-b8087e9de4f5 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:22:45 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Acquiring lock "cinder-47655dac-c17a-4331-85be-de3a42395a4d-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:45 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:45 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 1073741824 Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-89a4f11f-b7a6-4846-9922-3ae7eed8342d tempest-VolumeRetypeWithoutMigrationTest-891340251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.905s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-89a4f11f-b7a6-4846-9922-3ae7eed8342d tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:22:45 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Lock "cinder-47655dac-c17a-4331-85be-de3a42395a4d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-89a4f11f-b7a6-4846-9922-3ae7eed8342d tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Retype volume completed successfully. Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Acquiring lock "cinder-quobyte-47655dac-c17a-4331-85be-de3a42395a4d" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Lock "cinder-quobyte-47655dac-c17a-4331-85be-de3a42395a4d" acquired by "delete_volume" :: waited 0.020s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d703ff11-1ea3-48d5-89bd-46ef8909fdcc]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-47655dac-c17a-4331-85be-de3a42395a4d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:46 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-47655dac-c17a-4331-85be-de3a42395a4d Jun 04 13:22:46 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:46 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:46 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-47655dac-c17a-4331-85be-de3a42395a4d" returned: 0 in 0.739s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 1073741824" returned: 0 in 0.862s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-47655dac-c17a-4331-85be-de3a42395a4d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:46 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-47655dac-c17a-4331-85be-de3a42395a4d Jun 04 13:22:46 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:46 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 Jun 04 13:22:46 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:47 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-47655dac-c17a-4331-85be-de3a42395a4d" returned: 0 in 0.747s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Lock "cinder-quobyte-47655dac-c17a-4331-85be-de3a42395a4d" released by "delete_volume" :: held 1.540s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:47 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5" returned: 0 in 0.743s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:47 devstack cinder-volume[86722]: WARNING cinder.quota [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:22:47 devstack cinder-volume[86722]: WARNING cinder.quota [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754ddfa3-826b-40e7-99d0-32b567024204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f493cce0-8278-4413-b537-25b64605e978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:22:47 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Volume volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 (a79ceaba-5f72-4604-ac1f-b8087e9de4f5): created successfully Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f493cce0-8278-4413-b537-25b64605e978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Flow 'volume_create_manager' (785b2973-d964-46c8-bca2-3ee8efe5bfbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Created reservations ['5c1ec117-4027-4817-8f96-03968ee88a8a', '0b48e6d0-c21f-4f8b-8e92-da22039c522c', '649535bc-c89a-4c2f-9094-2d098c16775d', '523c243a-a8ac-42ca-86aa-21203ca12a0e'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:47 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b8f95db7-3417-417b-a566-211333751955 tempest-SnapshotMetadataTestJSON-778825993 None] Created volume successfully. Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:47 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:22:47 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] Creating offline snapshot 3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db of volume a79ceaba-5f72-4604-ac1f-b8087e9de4f5 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[773f20fb-837e-4f36-8e43-edad224b885c]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:48 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 Jun 04 13:22:48 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:48 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.919s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:48 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:22:48 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Deleted volume successfully. Jun 04 13:22:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8596191c-c921-49be-a9ee-78d4936a7776 tempest-VolumeRetypeWithoutMigrationTest-891340251 None] Lock "cinder-47655dac-c17a-4331-85be-de3a42395a4d-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:49 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5" returned: 0 in 1.280s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:49 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db 1G Jun 04 13:22:49 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:50 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db 1G" returned: 0 in 0.913s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:50 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db Jun 04 13:22:50 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:50 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db" returned: 0 in 0.805s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:50 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db is being set with open permissions: ugo+rw Jun 04 13:22:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:51 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db Jun 04 13:22:51 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:51 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db" returned: 0 in 0.748s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:51 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.info Jun 04 13:22:51 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:52 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.info" returned: 0 in 0.641s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:52 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.info is being set with open permissions: ugo+rw Jun 04 13:22:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:52 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.info Jun 04 13:22:52 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:53 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.info" returned: 0 in 0.634s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.132s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:53 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c174d980-c86c-475b-8630-ec042ed6c4e9 tempest-SnapshotMetadataTestJSON-778825993 None] Create snapshot completed successfully Jun 04 13:22:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Acquiring lock "cinder-3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "cinder-3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Acquiring lock "cinder-quobyte-a79ceaba-5f72-4604-ac1f-b8087e9de4f5" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "cinder-quobyte-a79ceaba-5f72-4604-ac1f-b8087e9de4f5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Acquiring lock "cinder-quobyte-3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "cinder-quobyte-3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Deleting offline snapshot 3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db of volume a79ceaba-5f72-4604-ac1f-b8087e9de4f5 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] snapshot_file for this snap is: volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78a236d-8d5b-4e03-bc23-71c2f0e2be2a]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:54 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db Jun 04 13:22:54 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:54 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db" returned: 0 in 0.749s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[21296f54-cfef-4c28-8e91-0e434e94e62c]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:55 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 Jun 04 13:22:55 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:55 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5" returned: 0 in 0.908s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:55 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db Jun 04 13:22:55 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Acquiring lock "cinder-276010a7-7665-4449-9a34-76e4a0dd41a0-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "cinder-276010a7-7665-4449-9a34-76e4a0dd41a0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:56 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:INSERT=25,cinder:SELECT=94,cinder:UPDATE=104,cinder:DELETE=8 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:22:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Acquiring lock "cinder-quobyte-276010a7-7665-4449-9a34-76e4a0dd41a0" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "cinder-quobyte-276010a7-7665-4449-9a34-76e4a0dd41a0" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:56 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e86719-9746-4f23-b1c1-dd8b4ec54bd5]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-276010a7-7665-4449-9a34-76e4a0dd41a0 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:56 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-276010a7-7665-4449-9a34-76e4a0dd41a0 Jun 04 13:22:56 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:56 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db" returned: 0 in 0.934s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:56 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db Jun 04 13:22:56 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:57 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-276010a7-7665-4449-9a34-76e4a0dd41a0" returned: 0 in 0.851s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-276010a7-7665-4449-9a34-76e4a0dd41a0 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:57 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-276010a7-7665-4449-9a34-76e4a0dd41a0 Jun 04 13:22:57 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:57 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5.3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db" returned: 0 in 0.875s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "cinder-quobyte-3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db" released by "_delete_snapshot" :: held 3.599s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "cinder-quobyte-a79ceaba-5f72-4604-ac1f-b8087e9de4f5" released by "delete_snapshot" :: held 3.628s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:57 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Created reservations ['a1acead0-6a7f-4ada-baa5-30bc3d3c5b8a', 'aed3a44b-146f-4eb5-b999-ca04dfa6a2ee', '6b1d57c1-12ab-47f6-b936-11e59adc8ba4', '02988773-c620-49e8-9077-828136324223'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:57 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Delete snapshot completed successfully. Jun 04 13:22:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2611529e-2105-4dfa-82c6-2471a796d145 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "cinder-3b4b89cd-08ae-4c00-a377-bcd7ad3fe0db-delete_snapshot" released by "delete_snapshot" :: held 3.793s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:58 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-276010a7-7665-4449-9a34-76e4a0dd41a0" returned: 0 in 0.755s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "cinder-quobyte-276010a7-7665-4449-9a34-76e4a0dd41a0" released by "delete_volume" :: held 1.660s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Created reservations ['d354a83f-28a1-48e8-bf88-a390c057eda0', '3bd7a6ed-20ee-4cb0-9403-9a512650fa3c', 'b7410d15-3e53-4413-bf62-e3172a989444', 'b5be705c-bb9b-49e1-a6ba-220549d8aedb'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:58 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:22:58 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Acquiring lock "cinder-a79ceaba-5f72-4604-ac1f-b8087e9de4f5-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "cinder-a79ceaba-5f72-4604-ac1f-b8087e9de4f5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Acquiring lock "cinder-quobyte-a79ceaba-5f72-4604-ac1f-b8087e9de4f5" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "cinder-quobyte-a79ceaba-5f72-4604-ac1f-b8087e9de4f5" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff4c923-982d-48e4-b9b2-fb17bb9bf07f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:58 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 Jun 04 13:22:58 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Acquiring lock "cinder-1a38ef68-65d3-4c1d-91d5-de6e714a3767-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "cinder-1a38ef68-65d3-4c1d-91d5-de6e714a3767-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Acquiring lock "cinder-quobyte-1a38ef68-65d3-4c1d-91d5-de6e714a3767" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "cinder-quobyte-1a38ef68-65d3-4c1d-91d5-de6e714a3767" acquired by "delete_volume" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3483a6f-c55c-4c97-8576-9db13617c85c]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:22:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:59 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767 Jun 04 13:22:59 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:59 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.902s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:59 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:22:59 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Deleted volume successfully. Jun 04 13:22:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-699a0cc6-130c-472d-ab6f-c4030f0f95a1 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "cinder-276010a7-7665-4449-9a34-76e4a0dd41a0-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:22:59 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5" returned: 0 in 1.052s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:59 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5 Jun 04 13:22:59 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:22:59 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Jun 04 13:22:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767" returned: 0 in 0.955s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:22:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:22:59 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767 Jun 04 13:22:59 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:00 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a79ceaba-5f72-4604-ac1f-b8087e9de4f5" returned: 0 in 0.880s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "cinder-quobyte-a79ceaba-5f72-4604-ac1f-b8087e9de4f5" released by "delete_volume" :: held 2.039s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Created reservations ['a8ac0a04-c86f-4dcd-8b85-e92011cf4492', '54b294d8-b69d-4446-9f2a-0e5ee0740e41', 'a411a338-5775-4d1a-8b91-76241bbba067', 'aa03ac9c-772a-4506-9a93-065170479ca3'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:23:00 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a38ef68-65d3-4c1d-91d5-de6e714a3767" returned: 0 in 0.735s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "cinder-quobyte-1a38ef68-65d3-4c1d-91d5-de6e714a3767" released by "delete_volume" :: held 1.756s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:00 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:23:00 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Created reservations ['c538e877-bdd2-49be-8b88-146a9f7aa543', '51d3bf1f-4b72-4acd-9917-6a0f2e7fc81c', 'd9d38257-0dd3-49f3-ab3e-58f0983fc04c', 'ac42d335-ce04-4c36-ba46-67c72c19b31f'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:00 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:23:00 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:01 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.662s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:01 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:23:01 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Deleted volume successfully. Jun 04 13:23:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3a373de8-5514-4cc7-a56b-a66af36607d8 tempest-AttachVolumeShelveTestJSON-1481835787 None] Lock "cinder-1a38ef68-65d3-4c1d-91d5-de6e714a3767-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:01 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.910s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:01 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:23:01 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Deleted volume successfully. Jun 04 13:23:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f00090cb-b94f-4524-94ae-18c6e3c6f0f0 tempest-SnapshotMetadataTestJSON-778825993 None] Lock "cinder-a79ceaba-5f72-4604-ac1f-b8087e9de4f5-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Flow 'volume_create_manager' (e9854808-a745-4e74-9f71-a98fded6a3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ea8ef8-2b5b-407e-b242-d7c28d9c7e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ea8ef8-2b5b-407e-b242-d7c28d9c7e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2045568359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b18ec9-e576-43e9-8786-35c9d8b1c245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f474037e26f94d00a3c8d5df8cd24703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:03Z,use_quota=True,user_id='d177172aa8ee4a5ebe2e522544ee1049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1673c275-edc1-4fb5-8660-c42e6f64d7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1673c275-edc1-4fb5-8660-c42e6f64d7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427aa883-6218-40b7-a436-fec03b2bdea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427aa883-6218-40b7-a436-fec03b2bdea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b18ec9-e576-43e9-8786-35c9d8b1c245', 'volume_name': 'volume-48b18ec9-e576-43e9-8786-35c9d8b1c245', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3bdc4e6-8c1b-41bc-8ad1-99f8c2792394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3bdc4e6-8c1b-41bc-8ad1-99f8c2792394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b70dbb0-3e0f-41be-af76-37acc662e05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:02 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Volume 48b18ec9-e576-43e9-8786-35c9d8b1c245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b18ec9-e576-43e9-8786-35c9d8b1c245', 'volume_size': 1} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2045568359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b18ec9-e576-43e9-8786-35c9d8b1c245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f474037e26f94d00a3c8d5df8cd24703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:03Z,use_quota=True,user_id='d177172aa8ee4a5ebe2e522544ee1049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Creating volume 48b18ec9-e576-43e9-8786-35c9d8b1c245 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:23:02 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:23:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-48b18ec9-e576-43e9-8786-35c9d8b1c245 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:02 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-48b18ec9-e576-43e9-8786-35c9d8b1c245 1073741824 Jun 04 13:23:02 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:03 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:23:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Flow 'volume_create_manager' (48d0899a-e6a6-4887-b517-6968e111cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a8d246-5c2c-4ec5-96e1-291bcc6b30b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a8d246-5c2c-4ec5-96e1-291bcc6b30b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2019162679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb222e7-4ad9-4f13-8f9a-9c959b15c0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d832723eb324b3fa5e83bc963ec896c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:03Z,use_quota=True,user_id='2ee329e4fe784cefa74cb92e88a04b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c80487e-2512-4278-bf51-a06ffafad5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c80487e-2512-4278-bf51-a06ffafad5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f92a54-eb24-448b-ad30-7587bb53f005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:03 devstack cinder-volume[86722]: DEBUG cinder.image.glance [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Creating Keystone auth plugin from conf {{(pid=86722) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:04 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f92a54-eb24-448b-ad30-7587bb53f005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'adb222e7-4ad9-4f13-8f9a-9c959b15c0f3', 'volume_name': 'volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3', 'volume_size': 1, 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6c11a9aab9d47a1bd95d90c20211b72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'created_at': datetime.datetime(2026, 6, 4, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba51743-79f8-4145-a751-7f4fa7bdd60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:04 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:23:04 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ba51743-79f8-4145-a751-7f4fa7bdd60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e896c5-d602-4a4d-ab7c-3eea673658a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:04 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Volume adb222e7-4ad9-4f13-8f9a-9c959b15c0f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3', 'volume_size': 1, 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6c11a9aab9d47a1bd95d90c20211b72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'created_at': datetime.datetime(2026, 6, 4, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Trying to clone adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 from image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]). {{(pid=86722) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-48b18ec9-e576-43e9-8786-35c9d8b1c245 1073741824" returned: 0 in 1.134s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-48b18ec9-e576-43e9-8786-35c9d8b1c245 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:04 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-48b18ec9-e576-43e9-8786-35c9d8b1c245 Jun 04 13:23:04 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 13:23:04 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Image download 20.69 MB at 20.69 MB/s Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1f4469-50d2-4796-ad40-398f81d3e31b]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:04 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD Jun 04 13:23:04 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:05 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.014s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:23:05 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-48b18ec9-e576-43e9-8786-35c9d8b1c245" returned: 0 in 0.980s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] <== create_volume: return (2163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.166s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b70dbb0-3e0f-41be-af76-37acc662e05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b18ec9-e576-43e9-8786-35c9d8b1c245', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ea6758-be26-4615-8a95-a73347d988ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:05 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Volume volume-48b18ec9-e576-43e9-8786-35c9d8b1c245 (48b18ec9-e576-43e9-8786-35c9d8b1c245): created successfully Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6ea6758-be26-4615-8a95-a73347d988ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Flow 'volume_create_manager' (e9854808-a745-4e74-9f71-a98fded6a3df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:05 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-3f50d887-dd0c-4ba9-8bd4-40c777313748 tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Created volume successfully. Jun 04 13:23:05 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD" returned: 0 in 1.026s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Temporary image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d is fetched for user 2ee329e4fe784cefa74cb92e88a04b18. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Flow 'volume_create_manager' (d19173a9-9c27-4a0c-b10b-2b8e204bc6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e695f7c-2386-47b8-a178-8a2c7baf706e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dcb66e-9145-4fce-8048-5c709659cd11]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e695f7c-2386-47b8-a178-8a2c7baf706e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-303333140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15eb7796-5b7d-4b35-9227-3fafd4e53d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1146e0a035de434bb4c4b14ab0e5d87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:06Z,use_quota=True,user_id='28ada580ecb64eb7a9480ae0054f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dde9982-4285-4f72-a70d-05a9ff636c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dde9982-4285-4f72-a70d-05a9ff636c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67739172-cf39-4da4-98ba-dd73e488f566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67739172-cf39-4da4-98ba-dd73e488f566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15eb7796-5b7d-4b35-9227-3fafd4e53d64', 'volume_name': 'volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22335079-c45e-424a-b8ac-b6a3bf1af0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22335079-c45e-424a-b8ac-b6a3bf1af0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95680af5-2ee5-4346-8351-3d3a290ec93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:05 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Volume 15eb7796-5b7d-4b35-9227-3fafd4e53d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64', 'volume_size': 1} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-303333140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15eb7796-5b7d-4b35-9227-3fafd4e53d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1146e0a035de434bb4c4b14ab0e5d87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:06Z,use_quota=True,user_id='28ada580ecb64eb7a9480ae0054f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Creating volume 15eb7796-5b7d-4b35-9227-3fafd4e53d64 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:23:05 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:23:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:05 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 1073741824 Jun 04 13:23:05 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:05 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD Jun 04 13:23:05 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:06 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD" returned: 0 in 0.834s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:06 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 1073741824" returned: 0 in 0.963s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:06 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 Jun 04 13:23:06 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Acquiring lock "cinder-48b18ec9-e576-43e9-8786-35c9d8b1c245-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Lock "cinder-48b18ec9-e576-43e9-8786-35c9d8b1c245-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Acquiring lock "cinder-quobyte-48b18ec9-e576-43e9-8786-35c9d8b1c245" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Lock "cinder-quobyte-48b18ec9-e576-43e9-8786-35c9d8b1c245" acquired by "delete_volume" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4728b3e-fa29-4168-a580-7f36e33e24f5]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-48b18ec9-e576-43e9-8786-35c9d8b1c245 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:07 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-48b18ec9-e576-43e9-8786-35c9d8b1c245 Jun 04 13:23:07 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:07 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64" returned: 0 in 0.642s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2019162679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb222e7-4ad9-4f13-8f9a-9c959b15c0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d832723eb324b3fa5e83bc963ec896c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:03Z,use_quota=True,user_id='2ee329e4fe784cefa74cb92e88a04b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Creating volume adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:23:07 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:07 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 1073741824 Jun 04 13:23:07 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95680af5-2ee5-4346-8351-3d3a290ec93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5dee14e-c691-4ceb-8607-a3e7f16be0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:07 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Volume volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 (15eb7796-5b7d-4b35-9227-3fafd4e53d64): created successfully Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5dee14e-c691-4ceb-8607-a3e7f16be0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Flow 'volume_create_manager' (d19173a9-9c27-4a0c-b10b-2b8e204bc6dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:07 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fa8b43eb-44af-44d4-91dc-24ea43caab38 tempest-VolumesDeleteCascade-1254491887 None] Created volume successfully. Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:08 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-48b18ec9-e576-43e9-8786-35c9d8b1c245" returned: 0 in 0.824s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-48b18ec9-e576-43e9-8786-35c9d8b1c245 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:08 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-48b18ec9-e576-43e9-8786-35c9d8b1c245 Jun 04 13:23:08 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:08 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 1073741824" returned: 0 in 0.928s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:08 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 Jun 04 13:23:08 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:08 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-48b18ec9-e576-43e9-8786-35c9d8b1c245" returned: 0 in 0.658s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Lock "cinder-quobyte-48b18ec9-e576-43e9-8786-35c9d8b1c245" released by "delete_volume" :: held 1.526s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Created reservations ['7f8c8bdb-cd66-486d-b167-f5f70a90c838', '63d58c3b-2349-4833-ad12-f6503d217336', 'f42512ca-b120-44df-b547-f7dd4fba3a73', 'f11ed4ec-4574-4f12-8afa-38de6c2baac0'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:08 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:23:08 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:09 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3" returned: 0 in 0.659s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.071s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] Creating offline snapshot e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 of volume 15eb7796-5b7d-4b35-9227-3fafd4e53d64 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Attempting download of 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d ((None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}])) to volume adb222e7-4ad9-4f13-8f9a-9c959b15c0f3. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[608d7f44-7aed-47a0-a2ac-934d932a0c4c]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aff2481-87b1-4de9-b0ca-e57453174a7d]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_ro2agom6 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:09 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 Jun 04 13:23:09 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:09 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_ro2agom6 Jun 04 13:23:09 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:09 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.878s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:23:09 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Deleted volume successfully. Jun 04 13:23:09 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-41fb72f3-0cbf-48a2-bf74-0b03898969ac tempest-VolumeQuotasNegativeTestJSON-2039551568 None] Lock "cinder-48b18ec9-e576-43e9-8786-35c9d8b1c245-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:10 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_ro2agom6" returned: 0 in 0.853s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_ro2agom6 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:10 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64" returned: 0 in 0.986s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:10 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 1G Jun 04 13:23:10 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:10 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_ro2agom6 Jun 04 13:23:10 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:11 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_ro2agom6" returned: 1 in 0.848s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_ro2agom6' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:23:11 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a9a6d1-1978-4ffb-8674-b65fa8562429]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:11 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:11 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD Jun 04 13:23:11 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 1G" returned: 0 in 0.913s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:11 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 Jun 04 13:23:11 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:11 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD" returned: 0 in 0.809s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:11 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d was qcow2, converting to raw {{(pid=86722) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 13:23:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:11 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 Jun 04 13:23:11 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:11 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44" returned: 0 in 0.753s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:11 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 is being set with open permissions: ugo+rw Jun 04 13:23:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:12 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 Jun 04 13:23:12 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:12 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44" returned: 0 in 0.761s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:12 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.info Jun 04 13:23:12 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:13 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.info" returned: 0 in 0.954s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:13 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.info is being set with open permissions: ugo+rw Jun 04 13:23:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:13 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.info Jun 04 13:23:13 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:14 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3" returned: 0 in 2.716s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:14 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8bg1izq7devstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:23:14 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Converted 112.00 MB image at 41.21 MB/s Jun 04 13:23:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:14 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 1G Jun 04 13:23:14 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:14 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.info" returned: 0 in 0.967s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.508s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:14 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a1a50918-c512-4d50-a317-d1969424253f tempest-VolumesDeleteCascade-1254491887 None] Create snapshot completed successfully Jun 04 13:23:15 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 1G" returned: 0 in 0.738s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:15 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[922893f3-a9e7-4e39-be75-cf33e6342a2c]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:15 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 Jun 04 13:23:15 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] Creating offline snapshot 70897f0c-263b-4e7d-b734-6f1938a9db2b of volume 15eb7796-5b7d-4b35-9227-3fafd4e53d64 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:23:15 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4142a71-22b0-407b-b48e-95b977b3d730]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:16 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 Jun 04 13:23:16 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:16 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3" returned: 0 in 0.924s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:16 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 Jun 04 13:23:16 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:16 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44" returned: 0 in 1.116s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:16 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:23:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:17 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b 1G Jun 04 13:23:17 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:17 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3" returned: 1 in 1.030s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:23:17 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Downloaded image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d ((None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}])) to volume adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 successfully. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 13:23:17 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Temporary image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d for user 2ee329e4fe784cefa74cb92e88a04b18 is deleted. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 13:23:17 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Marking volume adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 as bootable. {{(pid=86722) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 13:23:17 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Copying metadata from image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d to adb222e7-4ad9-4f13-8f9a-9c959b15c0f3. {{(pid=86722) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 13:23:17 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Creating volume glance metadata for volume adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 backed by image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86722) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 13:23:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e896c5-d602-4a4d-ab7c-3eea673658a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3', 'volume_size': 1, 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6c11a9aab9d47a1bd95d90c20211b72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'created_at': datetime.datetime(2026, 6, 4, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0897da99-4651-4b1a-a591-150a15d84ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:17 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Volume volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 (adb222e7-4ad9-4f13-8f9a-9c959b15c0f3): created successfully Jun 04 13:23:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0897da99-4651-4b1a-a591-150a15d84ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Flow 'volume_create_manager' (48d0899a-e6a6-4887-b517-6968e111cba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:17 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a0d1adba-25c2-4dd5-9724-e4d2e76d1e59 tempest-VolumesImageMetadata-238916557 None] Created volume successfully. Jun 04 13:23:18 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b 1G" returned: 0 in 1.091s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:18 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b Jun 04 13:23:18 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:18 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b" returned: 0 in 0.803s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:18 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b is being set with open permissions: ugo+rw Jun 04 13:23:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:18 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b Jun 04 13:23:18 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Acquiring lock "cinder-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Lock "cinder-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Acquiring lock "cinder-quobyte-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Lock "cinder-quobyte-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3" acquired by "delete_volume" :: waited 0.031s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:19 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10105a3-e874-4205-92f1-4367dcb6e220]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:19 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 Jun 04 13:23:19 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:19 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b" returned: 0 in 0.799s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.961s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:19 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c82368e8-54fd-44f5-b1f8-d2fe22b06aba tempest-VolumesDeleteCascade-1254491887 None] Create snapshot completed successfully Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-15eb7796-5b7d-4b35-9227-3fafd4e53d64-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-15eb7796-5b7d-4b35-9227-3fafd4e53d64-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Performing cascade delete. {{(pid=86722) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-70897f0c-263b-4e7d-b734-6f1938a9db2b-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-70897f0c-263b-4e7d-b734-6f1938a9db2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-quobyte-15eb7796-5b7d-4b35-9227-3fafd4e53d64" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-15eb7796-5b7d-4b35-9227-3fafd4e53d64" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-quobyte-70897f0c-263b-4e7d-b734-6f1938a9db2b" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:20 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3" returned: 0 in 0.909s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-70897f0c-263b-4e7d-b734-6f1938a9db2b" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Deleting offline snapshot 70897f0c-263b-4e7d-b734-6f1938a9db2b of volume 15eb7796-5b7d-4b35-9227-3fafd4e53d64 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] snapshot_file for this snap is: volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b5e654-d420-4a79-8453-dd993fae4ff8]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:20 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 Jun 04 13:23:20 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:20 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b Jun 04 13:23:20 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:21 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b" returned: 0 in 0.770s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:23:21 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2483f5-8225-4887-bf88-feea626a673a]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:21 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3" returned: 1 in 1.074s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:23:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:21 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 Jun 04 13:23:21 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:21 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3 Jun 04 13:23:21 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:22 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44" returned: 0 in 0.913s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:23:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:22 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3" returned: 0 in 0.755s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Lock "cinder-quobyte-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3" released by "delete_volume" :: held 2.858s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:22 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b Jun 04 13:23:22 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:22 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Created reservations ['943fb1d7-98c0-4889-b830-fe3b75cd7b20', '60382521-7d0c-400a-824f-33dfc0c2d847', '562fda08-7a57-41d5-9b98-36eafcc3818f', '77e07d3f-4edd-4058-a0ca-4ffe6624ac12'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:23:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:22 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:23:22 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:22 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b" returned: 0 in 0.965s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:23 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.813s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:23 devstack sudo[94055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:23:23 devstack sudo[94055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:23 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Deleted volume successfully. Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8fda60de-6f94-432f-a415-8a9ca273a748 tempest-VolumesImageMetadata-238916557 None] Lock "cinder-adb222e7-4ad9-4f13-8f9a-9c959b15c0f3-delete_volume" released by "delete_volume" :: held 3.982s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:23 devstack sudo[94055]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.70897f0c-263b-4e7d-b734-6f1938a9db2b" returned: 0 in 0.711s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-70897f0c-263b-4e7d-b734-6f1938a9db2b" released by "_delete_snapshot" :: held 3.511s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-15eb7796-5b7d-4b35-9227-3fafd4e53d64" released by "delete_snapshot" :: held 3.562s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Created reservations ['817915d7-584e-4ca2-93d5-9c21b7d1c458', '7daab14c-0968-4140-a562-56cb4a48f4f4', '65114c35-bc79-4183-ae44-10c01e368ba3', 'abf069df-f0cb-425c-b2f3-a8a7fd8c5095'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:23:23 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Delete snapshot completed successfully. Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-70897f0c-263b-4e7d-b734-6f1938a9db2b-delete_snapshot" released by "delete_snapshot" :: held 3.735s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-e4a2ea9c-b3ae-4863-a563-e76dc15ecc44-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-e4a2ea9c-b3ae-4863-a563-e76dc15ecc44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-quobyte-15eb7796-5b7d-4b35-9227-3fafd4e53d64" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-15eb7796-5b7d-4b35-9227-3fafd4e53d64" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-quobyte-e4a2ea9c-b3ae-4863-a563-e76dc15ecc44" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-e4a2ea9c-b3ae-4863-a563-e76dc15ecc44" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Deleting offline snapshot e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 of volume 15eb7796-5b7d-4b35-9227-3fafd4e53d64 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:23:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] snapshot_file for this snap is: volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:23:24 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c16d64c-51af-4ac6-9e8f-4ef8211b1688]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:24 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 Jun 04 13:23:24 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:24 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44" returned: 0 in 0.821s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:24 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:23:24 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[042a1858-8586-4113-b04f-822042bc29e8]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:25 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 Jun 04 13:23:25 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:25 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64" returned: 0 in 0.996s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:25 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 Jun 04 13:23:25 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:26 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44" returned: 0 in 0.857s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:26 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44 Jun 04 13:23:26 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:27 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64.e4a2ea9c-b3ae-4863-a563-e76dc15ecc44" returned: 0 in 0.800s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:27 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-e4a2ea9c-b3ae-4863-a563-e76dc15ecc44" released by "_delete_snapshot" :: held 3.616s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:27 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-15eb7796-5b7d-4b35-9227-3fafd4e53d64" released by "delete_snapshot" :: held 3.642s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:27 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Created reservations ['6c75f72e-a015-4a29-9dc6-30300f6ea9ea', '5fd96195-ae3a-4075-9c1a-b8f207cbfe36', '9fb66417-8462-44cb-9904-f7875e8dab47', 'd1444874-5ded-4727-a021-66b5c5f11058'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:23:27 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Delete snapshot completed successfully. Jun 04 13:23:27 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-e4a2ea9c-b3ae-4863-a563-e76dc15ecc44-delete_snapshot" released by "delete_snapshot" :: held 3.850s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Snapshots deleted, issuing volume delete {{(pid=86722) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jun 04 13:23:27 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-quobyte-15eb7796-5b7d-4b35-9227-3fafd4e53d64" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:27 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-15eb7796-5b7d-4b35-9227-3fafd4e53d64" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:27 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed40f26b-aa0e-4de3-815c-8bb78e13aa76]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:28 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 Jun 04 13:23:28 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:28 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64" returned: 0 in 1.005s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:28 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64 Jun 04 13:23:28 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:29 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-15eb7796-5b7d-4b35-9227-3fafd4e53d64" returned: 0 in 0.801s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-15eb7796-5b7d-4b35-9227-3fafd4e53d64" released by "delete_volume" :: held 1.904s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:29 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Created reservations ['62277d3d-6b86-4202-bf78-454ecdf8985e', 'd19abe89-2ffa-435d-a1f0-4db2d5c893f0', '374f0097-e685-4b8b-8462-204b7df69f24', 'd92fe30b-86bc-4f0c-9da1-87f706da20b1'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:23:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:29 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:23:29 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:30 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.865s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:23:30 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Deleted volume successfully. Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-1bb3d1ee-d14d-4a4d-8a95-bf41b9962875 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-15eb7796-5b7d-4b35-9227-3fafd4e53d64-delete_volume" released by "delete_volume" :: held 10.689s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Flow 'volume_create_manager' (2e9be34e-707a-46be-b2d4-8216b6026463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f505f6-748b-4731-a99c-95bc06168f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8f505f6-748b-4731-a99c-95bc06168f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1372560109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e609ec96-9c93-4653-a00c-e3e5fe68a997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1146e0a035de434bb4c4b14ab0e5d87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:31Z,use_quota=True,user_id='28ada580ecb64eb7a9480ae0054f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf15329-2fee-423a-a0ce-cb6482b7583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf15329-2fee-423a-a0ce-cb6482b7583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d660b5f-5bbc-4756-846b-93870e09637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d660b5f-5bbc-4756-846b-93870e09637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e609ec96-9c93-4653-a00c-e3e5fe68a997', 'volume_name': 'volume-e609ec96-9c93-4653-a00c-e3e5fe68a997', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16ef74e-e2fc-482f-8cf6-84f9f0333c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16ef74e-e2fc-482f-8cf6-84f9f0333c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614801b8-24da-40dc-997e-2b73b834540c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:30 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Volume e609ec96-9c93-4653-a00c-e3e5fe68a997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e609ec96-9c93-4653-a00c-e3e5fe68a997', 'volume_size': 1} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1372560109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e609ec96-9c93-4653-a00c-e3e5fe68a997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1146e0a035de434bb4c4b14ab0e5d87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:31Z,use_quota=True,user_id='28ada580ecb64eb7a9480ae0054f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Creating volume e609ec96-9c93-4653-a00c-e3e5fe68a997 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:23:30 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:23:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:31 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 1073741824 Jun 04 13:23:31 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:31 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 1073741824" returned: 0 in 0.914s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:31 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 Jun 04 13:23:31 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Flow 'volume_create_manager' (33b5f5bb-4437-4bc9-b583-6920b4bdc793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a8b477-8784-412a-a8bb-8f6e27960caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a8b477-8784-412a-a8bb-8f6e27960caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-232950185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58a91e7-7531-41fc-9400-4d9e2a819c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e604fd9a35f4de590b0507ea95ebf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:32Z,use_quota=True,user_id='8647f6cc02dd4268ad2def05efaabdf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3803f8ed-2c39-48df-8435-501d59608658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3803f8ed-2c39-48df-8435-501d59608658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc694a18-6b09-4411-9ab3-6ad31beeccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc694a18-6b09-4411-9ab3-6ad31beeccdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a58a91e7-7531-41fc-9400-4d9e2a819c8c', 'volume_name': 'volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866adda8-963a-4447-aa92-1e3b16da7a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866adda8-963a-4447-aa92-1e3b16da7a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a450393b-0087-499d-bc44-81357d900c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:32 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Volume a58a91e7-7531-41fc-9400-4d9e2a819c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c', 'volume_size': 1} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:32 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997" returned: 0 in 0.814s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.165s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-232950185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58a91e7-7531-41fc-9400-4d9e2a819c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e604fd9a35f4de590b0507ea95ebf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:32Z,use_quota=True,user_id='8647f6cc02dd4268ad2def05efaabdf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Creating volume a58a91e7-7531-41fc-9400-4d9e2a819c8c {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:23:32 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:32 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c 1073741824 Jun 04 13:23:32 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614801b8-24da-40dc-997e-2b73b834540c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e609ec96-9c93-4653-a00c-e3e5fe68a997', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a540bf-0dfd-4a65-940b-eac77a0c9ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:32 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Volume volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 (e609ec96-9c93-4653-a00c-e3e5fe68a997): created successfully Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a540bf-0dfd-4a65-940b-eac77a0c9ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Flow 'volume_create_manager' (2e9be34e-707a-46be-b2d4-8216b6026463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:32 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-847d4f34-20bf-4338-9a7f-33c541e6f33b tempest-VolumesDeleteCascade-1254491887 None] Created volume successfully. Jun 04 13:23:33 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c 1073741824" returned: 0 in 1.126s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:33 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c Jun 04 13:23:33 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:34 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c" returned: 0 in 0.977s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:34 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] <== create_volume: return (2152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:23:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.309s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:34 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] Creating offline snapshot f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 of volume e609ec96-9c93-4653-a00c-e3e5fe68a997 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:23:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a450393b-0087-499d-bc44-81357d900c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01ce822-10b1-4b74-85ee-253bfe92ce09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:34 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0daa80-95ab-47a1-a536-d2edd1797207]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:34 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Volume volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c (a58a91e7-7531-41fc-9400-4d9e2a819c8c): created successfully Jun 04 13:23:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f01ce822-10b1-4b74-85ee-253bfe92ce09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Flow 'volume_create_manager' (33b5f5bb-4437-4bc9-b583-6920b4bdc793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:35 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-cd89903f-9cbb-45b4-8e66-46cc05503b64 tempest-VolumesTransfersV357Test-1459151918 None] Created volume successfully. Jun 04 13:23:35 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 Jun 04 13:23:35 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:35 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997" returned: 0 in 0.811s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:35 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 1G Jun 04 13:23:35 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:36 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-5dbcdc31-a15d-49d0-9c15-f7401e0382b5 tempest-VolumesTransfersV357Test-1313492672 None] Transfer volume completed successfully. Jun 04 13:23:36 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 1G" returned: 0 in 0.942s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:36 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 Jun 04 13:23:36 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:37 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3" returned: 0 in 0.725s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:37 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 is being set with open permissions: ugo+rw Jun 04 13:23:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:37 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 Jun 04 13:23:37 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Acquiring lock "cinder-a58a91e7-7531-41fc-9400-4d9e2a819c8c-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Lock "cinder-a58a91e7-7531-41fc-9400-4d9e2a819c8c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Acquiring lock "cinder-quobyte-a58a91e7-7531-41fc-9400-4d9e2a819c8c" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Lock "cinder-quobyte-a58a91e7-7531-41fc-9400-4d9e2a819c8c" acquired by "delete_volume" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[91554ea6-10a3-40dc-9dca-758a9f65c5bc]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:38 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c Jun 04 13:23:38 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:38 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3" returned: 0 in 0.644s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:38 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.info Jun 04 13:23:38 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:38 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.info" returned: 0 in 0.691s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:38 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.info is being set with open permissions: ugo+rw Jun 04 13:23:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:38 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.info Jun 04 13:23:38 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:38 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c" returned: 0 in 0.966s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:38 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c Jun 04 13:23:38 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:39 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a58a91e7-7531-41fc-9400-4d9e2a819c8c" returned: 0 in 0.624s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:39 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.info" returned: 0 in 0.682s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.605s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Lock "cinder-quobyte-a58a91e7-7531-41fc-9400-4d9e2a819c8c" released by "delete_volume" :: held 1.663s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8280a452-c168-4e89-a621-16659f58fa11 tempest-VolumesDeleteCascade-1254491887 None] Create snapshot completed successfully Jun 04 13:23:39 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Created reservations ['9e54a0fb-b56c-4338-8dcf-c6b3ae0c2fc4', 'fbabdad8-80d4-4ab2-a078-fbe4375ad4d4', '7de1334a-dcae-45f4-8813-f4b003c146e3', '5adc4417-6db8-4d1c-90d0-2ff08e9034ae'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:23:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:39 devstack sudo[94207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:23:39 devstack sudo[94207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:40 devstack sudo[94207]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.267s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:40 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:23:40 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Deleted volume successfully. Jun 04 13:23:40 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-52206475-480d-4bef-8525-403faf624dea tempest-VolumesTransfersV357Test-2145743022 None] Lock "cinder-a58a91e7-7531-41fc-9400-4d9e2a819c8c-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Flow 'volume_create_manager' (ec98a4ac-89d8-4472-bc07-f6dff30daa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4779ca4-2003-48dd-a5d4-bcd11f573e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4779ca4-2003-48dd-a5d4-bcd11f573e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1983331072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75650dac-7234-4f90-99fa-7549b08135cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1146e0a035de434bb4c4b14ab0e5d87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f00a2bbd-e6b0-41dd-a720-f3251d7b30a3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:41Z,use_quota=True,user_id='28ada580ecb64eb7a9480ae0054f4f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e679eb88-a0f6-403c-9582-24fea57eec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e679eb88-a0f6-403c-9582-24fea57eec33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a17757-05a1-4402-9bc3-e351528e0ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a17757-05a1-4402-9bc3-e351528e0ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '75650dac-7234-4f90-99fa-7549b08135cb', 'volume_name': 'volume-75650dac-7234-4f90-99fa-7549b08135cb', 'volume_size': 1, 'snapshot_id': 'f00a2bbd-e6b0-41dd-a720-f3251d7b30a3'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ba8e0e-1b7a-42e4-96e0-f00f76be0cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ba8e0e-1b7a-42e4-96e0-f00f76be0cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c7cc37-eaf2-4d49-a725-700b7f194c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:41 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Volume 75650dac-7234-4f90-99fa-7549b08135cb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-75650dac-7234-4f90-99fa-7549b08135cb', 'volume_size': 1, 'snapshot_id': 'f00a2bbd-e6b0-41dd-a720-f3251d7b30a3'} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Flow 'volume_create_manager' (6216759b-0036-4d12-8be0-99e12b42645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c8431c-e20f-47a1-bfd5-e2a8d0d54829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-quobyte-f00a2bbd-e6b0-41dd-a720-f3251d7b30a3-75650dac-7234-4f90-99fa-7549b08135cb" by "_create_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c8431c-e20f-47a1-bfd5-e2a8d0d54829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-758417543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1979ce-d945-407f-b9d6-9cd1d9e6673a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e604fd9a35f4de590b0507ea95ebf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:41Z,use_quota=True,user_id='8647f6cc02dd4268ad2def05efaabdf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b710223-c9d7-428e-a7c6-814d5ba94f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b710223-c9d7-428e-a7c6-814d5ba94f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27fe4fa5-bf54-416c-b422-4c49677b9a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27fe4fa5-bf54-416c-b422-4c49677b9a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1979ce-d945-407f-b9d6-9cd1d9e6673a', 'volume_name': 'volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9645180c-83bc-451d-a19c-e46806b7a75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9645180c-83bc-451d-a19c-e46806b7a75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90763680-4121-4b6d-9d2d-cff33437770d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:41 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Volume 9a1979ce-d945-407f-b9d6-9cd1d9e6673a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a', 'volume_size': 1} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-f00a2bbd-e6b0-41dd-a720-f3251d7b30a3-75650dac-7234-4f90-99fa-7549b08135cb" acquired by "_create_volume_from_snapshot" :: waited 0.116s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Creating volume 75650dac-7234-4f90-99fa-7549b08135cb from snapshot f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 {{(pid=86722) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-quobyte-75650dac-7234-4f90-99fa-7549b08135cb" by "_copy_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-75650dac-7234-4f90-99fa-7549b08135cb" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] snapshot: f00a2bbd-e6b0-41dd-a720-f3251d7b30a3, volume: 75650dac-7234-4f90-99fa-7549b08135cb, {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aa0c0a-990b-498b-b50f-65df8894f560]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:41 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 Jun 04 13:23:41 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:42 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3" returned: 0 in 0.786s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e609ec96-9c93-4653-a00c-e3e5fe68a997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:23:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 13:23:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Creating direct copy from snapshot {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 13:23:42 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[503fbd57-d9a9-4a45-a222-2b0995f1e49f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:42 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 Jun 04 13:23:42 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:43 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997" returned: 0 in 0.994s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:43 devstack cinder-volume[86722]: DEBUG cinder.utils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Path /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb not found in is_blk_device check {{(pid=86722) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 13:23:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:43 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb Jun 04 13:23:43 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:51 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=78,cinder:INSERT=28,cinder:UPDATE=103,cinder:DELETE=3 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:23:51 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=102,cinder:UPDATE=103,cinder:INSERT=36,cinder:DELETE=12 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:23:52 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb" returned: 0 in 8.729s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:52 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b8442a-6aaf-4fab-903c-c83606067ec3]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:52 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 Jun 04 13:23:52 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:53 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997" returned: 0 in 1.319s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:53 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997, size 1024.00 MB, duration 8.73 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:23:53 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Converted 1024.00 MB image at 117.30 MB/s Jun 04 13:23:53 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb is being set with open permissions: ugo+rw Jun 04 13:23:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:53 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb Jun 04 13:23:53 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:54 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb" returned: 0 in 0.738s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-75650dac-7234-4f90-99fa-7549b08135cb" released by "_copy_volume_from_snapshot" :: held 12.745s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-f00a2bbd-e6b0-41dd-a720-f3251d7b30a3-75650dac-7234-4f90-99fa-7549b08135cb" released by "_create_volume_from_snapshot" :: held 12.799s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.919s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.821s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-758417543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1979ce-d945-407f-b9d6-9cd1d9e6673a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e604fd9a35f4de590b0507ea95ebf35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:23:41Z,use_quota=True,user_id='8647f6cc02dd4268ad2def05efaabdf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Creating volume 9a1979ce-d945-407f-b9d6-9cd1d9e6673a {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:23:54 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:54 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a 1073741824 Jun 04 13:23:54 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c7cc37-eaf2-4d49-a725-700b7f194c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75650dac-7234-4f90-99fa-7549b08135cb', 'volume_size': 1, 'snapshot_id': 'f00a2bbd-e6b0-41dd-a720-f3251d7b30a3'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03291daa-1a95-4f1d-9de7-37e310a05f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:54 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Volume volume-75650dac-7234-4f90-99fa-7549b08135cb (75650dac-7234-4f90-99fa-7549b08135cb): created successfully Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03291daa-1a95-4f1d-9de7-37e310a05f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Flow 'volume_create_manager' (ec98a4ac-89d8-4472-bc07-f6dff30daa1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:54 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-172137e2-b7ff-417e-80ab-c9a2b6e52123 tempest-VolumesDeleteCascade-1254491887 None] Created volume successfully. Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-e609ec96-9c93-4653-a00c-e3e5fe68a997-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-e609ec96-9c93-4653-a00c-e3e5fe68a997-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Performing cascade delete. {{(pid=86722) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-f00a2bbd-e6b0-41dd-a720-f3251d7b30a3-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-f00a2bbd-e6b0-41dd-a720-f3251d7b30a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-quobyte-e609ec96-9c93-4653-a00c-e3e5fe68a997" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-e609ec96-9c93-4653-a00c-e3e5fe68a997" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-quobyte-f00a2bbd-e6b0-41dd-a720-f3251d7b30a3" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-f00a2bbd-e6b0-41dd-a720-f3251d7b30a3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Deleting offline snapshot f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 of volume e609ec96-9c93-4653-a00c-e3e5fe68a997 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] snapshot_file for this snap is: volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[0123e8e4-718e-447f-9818-fd675d39aebd]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:55 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a 1073741824" returned: 0 in 1.076s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:55 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a Jun 04 13:23:55 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:55 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 Jun 04 13:23:55 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:55 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a" returned: 0 in 0.741s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:23:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90763680-4121-4b6d-9d2d-cff33437770d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7439c74-ec2d-4f96-bf1c-75785b0aaf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:23:56 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Volume volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a (9a1979ce-d945-407f-b9d6-9cd1d9e6673a): created successfully Jun 04 13:23:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7439c74-ec2d-4f96-bf1c-75785b0aaf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:23:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Flow 'volume_create_manager' (6216759b-0036-4d12-8be0-99e12b42645a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:23:56 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:56 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-33014220-402d-4179-8764-71805b1cb577 tempest-VolumesTransfersV357Test-1459151918 None] Created volume successfully. Jun 04 13:23:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3" returned: 0 in 0.927s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:56 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e609ec96-9c93-4653-a00c-e3e5fe68a997(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:23:56 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9982596-5d26-4861-8ff1-0e458a0e64c7]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:56 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 Jun 04 13:23:56 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:56 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997" returned: 0 in 0.737s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:56 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 Jun 04 13:23:56 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Acquiring lock "cinder-9a1979ce-d945-407f-b9d6-9cd1d9e6673a-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Lock "cinder-9a1979ce-d945-407f-b9d6-9cd1d9e6673a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Acquiring lock "cinder-quobyte-9a1979ce-d945-407f-b9d6-9cd1d9e6673a" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Lock "cinder-quobyte-9a1979ce-d945-407f-b9d6-9cd1d9e6673a" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:57 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab6827-b831-4ac7-9fbc-a39f882d41aa]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:57 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a Jun 04 13:23:57 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:57 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3" returned: 0 in 0.715s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:57 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3 Jun 04 13:23:57 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:58 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a" returned: 0 in 0.802s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:58 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a Jun 04 13:23:58 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:58 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997.f00a2bbd-e6b0-41dd-a720-f3251d7b30a3" returned: 0 in 0.624s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-f00a2bbd-e6b0-41dd-a720-f3251d7b30a3" released by "_delete_snapshot" :: held 3.133s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-e609ec96-9c93-4653-a00c-e3e5fe68a997" released by "delete_snapshot" :: held 3.159s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Created reservations ['f1b223b0-e413-4b13-ada3-1b3c03a11870', '376c29b3-088c-48fb-817b-fed2428625cf', '1db79be7-1199-46ec-a158-f4d546566229', '95879771-ebde-4f05-b45f-6bddcd1f69da'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:23:58 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Delete snapshot completed successfully. Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-f00a2bbd-e6b0-41dd-a720-f3251d7b30a3-delete_snapshot" released by "delete_snapshot" :: held 3.325s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Snapshots deleted, issuing volume delete {{(pid=86722) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-quobyte-e609ec96-9c93-4653-a00c-e3e5fe68a997" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-e609ec96-9c93-4653-a00c-e3e5fe68a997" acquired by "delete_volume" :: waited 0.020s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[4132bf15-2bb5-4bce-933d-c7decdd2cb9d]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:58 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 Jun 04 13:23:58 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:58 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a1979ce-d945-407f-b9d6-9cd1d9e6673a" returned: 0 in 0.643s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Lock "cinder-quobyte-9a1979ce-d945-407f-b9d6-9cd1d9e6673a" released by "delete_volume" :: held 1.488s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Created reservations ['7143a520-f7c5-40c1-9507-6ff52f122c29', 'c15b4d31-1696-4a9a-9e35-2dc17ed89d7e', 'd9caa171-f6ab-4900-a4dd-62fdb39be254', 'd96d9f1c-0ecd-4cb0-95af-c06f0e384807'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:23:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:58 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:23:58 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:59 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997" returned: 0 in 0.773s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:23:59 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997 Jun 04 13:23:59 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:23:59 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.881s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:59 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:23:59 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Deleted volume successfully. Jun 04 13:23:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-43641209-4fa7-4d95-be5d-49bc570e4355 tempest-VolumesTransfersV357Test-2145743022 None] Lock "cinder-9a1979ce-d945-407f-b9d6-9cd1d9e6673a-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:59 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Jun 04 13:23:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e609ec96-9c93-4653-a00c-e3e5fe68a997" returned: 0 in 0.701s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:23:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-e609ec96-9c93-4653-a00c-e3e5fe68a997" released by "delete_volume" :: held 1.551s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:23:59 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Created reservations ['b703afd6-790a-47b5-ae2e-e7d62cdd586a', '74bbb743-32a2-49eb-a8ce-a3d7e4fa3163', '3002e4cd-1339-4c5b-9bc0-f64b20814dff', '3a43ee2c-01b2-4905-b53e-093f1fda6aa0'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:00 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:24:00 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-75650dac-7234-4f90-99fa-7549b08135cb-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-75650dac-7234-4f90-99fa-7549b08135cb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "cinder-quobyte-75650dac-7234-4f90-99fa-7549b08135cb" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-75650dac-7234-4f90-99fa-7549b08135cb" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:00 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.807s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[820af50c-71e3-4b0e-aaef-67a3de497909]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:00 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Deleted volume successfully. Jun 04 13:24:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-27ff5620-e4bf-4959-b757-a014a4c5c5cd tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-e609ec96-9c93-4653-a00c-e3e5fe68a997-delete_volume" released by "delete_volume" :: held 5.966s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:01 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb Jun 04 13:24:01 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:01 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb" returned: 0 in 0.834s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:01 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb Jun 04 13:24:01 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:02 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-75650dac-7234-4f90-99fa-7549b08135cb" returned: 0 in 0.772s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:02 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-quobyte-75650dac-7234-4f90-99fa-7549b08135cb" released by "delete_volume" :: held 1.669s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:02 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Created reservations ['982b46fa-504f-4e2c-b8c5-56aa5e43bb5a', 'ad5ead17-55d8-44ab-8987-fcfca9c4fd8f', '28eb95f4-3271-4068-b1d9-51c449894dea', 'acb54902-7505-4991-a749-c202eb4df7ee'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:24:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:02 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:24:02 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:03 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.961s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:03 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:24:03 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Deleted volume successfully. Jun 04 13:24:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-034d13a1-6770-43c3-98cd-821f62e74c2a tempest-VolumesDeleteCascade-1254491887 None] Lock "cinder-75650dac-7234-4f90-99fa-7549b08135cb-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:24:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:04 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:24:04 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:04 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.844s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:24:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:24:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:24:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Flow 'volume_create_manager' (979fba1a-e795-4cf5-bcac-a8731dd97467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9799d14e-7b77-4788-9629-598741f2f5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9799d14e-7b77-4788-9629-598741f2f5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1489265470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e927234c-6d29-443b-9b00-0f845369ccfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a41550f3ed244e6a00b49a1e55c884b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:06Z,use_quota=True,user_id='34bd751d332c4f66ba1a17b999d7db3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835bc9dc-b2c3-4b8e-ab92-9807b8a2fc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (835bc9dc-b2c3-4b8e-ab92-9807b8a2fc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ebb602-9fb4-494f-9f78-70bbf2fdec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ebb602-9fb4-494f-9f78-70bbf2fdec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e927234c-6d29-443b-9b00-0f845369ccfa', 'volume_name': 'volume-e927234c-6d29-443b-9b00-0f845369ccfa', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3e9a94-1b2f-4a89-ba45-6c5f2369856d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3e9a94-1b2f-4a89-ba45-6c5f2369856d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff79c9f-148b-4b14-bf5e-2383ba69ed62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:05 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Volume e927234c-6d29-443b-9b00-0f845369ccfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e927234c-6d29-443b-9b00-0f845369ccfa', 'volume_size': 1} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1489265470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e927234c-6d29-443b-9b00-0f845369ccfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a41550f3ed244e6a00b49a1e55c884b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:06Z,use_quota=True,user_id='34bd751d332c4f66ba1a17b999d7db3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Creating volume e927234c-6d29-443b-9b00-0f845369ccfa {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:24:05 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:05 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa 1073741824 Jun 04 13:24:05 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (03e8f7c3-30a9-4ca3-95fe-444768f2b521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feda6d45-553d-4c7d-bba5-a476f6e27bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feda6d45-553d-4c7d-bba5-a476f6e27bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-72692235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:06Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22030423-6353-4ada-9615-ce2ad8984d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22030423-6353-4ada-9615-ce2ad8984d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b7cd01-0687-4e82-9d31-123ef08004c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b7cd01-0687-4e82-9d31-123ef08004c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c', 'volume_name': 'volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d23ce0f-f904-4f90-852f-6735a18edc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d23ce0f-f904-4f90-852f-6735a18edc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a50f572-82e7-4390-82bb-36effd14e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:05 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Volume 2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c', 'volume_size': 1} Jun 04 13:24:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Flow 'volume_create_manager' (2f343349-72e3-4c5a-9269-3e0a3df8cd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e16544-ddba-4c7d-a178-0059eeeb4dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67e16544-ddba-4c7d-a178-0059eeeb4dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1062018688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=119134e4-3f3d-40d2-a099-f917a6b2fd5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10d2e63a753425387b587a246991705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:07Z,use_quota=True,user_id='a6a647f9e16b465a80d217eccb1991ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e2fe68-fe79-49bb-957d-67c3abb76e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e2fe68-fe79-49bb-957d-67c3abb76e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279b8a85-345b-4e5d-9dd1-77526f70e5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279b8a85-345b-4e5d-9dd1-77526f70e5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '119134e4-3f3d-40d2-a099-f917a6b2fd5a', 'volume_name': 'volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:07 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d950558-52c6-4db9-9dbc-3126a274e918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d950558-52c6-4db9-9dbc-3126a274e918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42df777b-32c3-4025-8729-46c9ef3e9c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:07 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Volume 119134e4-3f3d-40d2-a099-f917a6b2fd5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a', 'volume_size': 1} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa 1073741824" returned: 0 in 1.423s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:07 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa Jun 04 13:24:07 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:08 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa" returned: 0 in 0.666s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] <== create_volume: return (2150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.043s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-72692235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:06Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Creating volume 2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:24:08 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff79c9f-148b-4b14-bf5e-2383ba69ed62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e927234c-6d29-443b-9b00-0f845369ccfa', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:08 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c 1073741824 Jun 04 13:24:08 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6de849-e8ea-43db-b88d-285a0858f18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:08 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Volume volume-e927234c-6d29-443b-9b00-0f845369ccfa (e927234c-6d29-443b-9b00-0f845369ccfa): created successfully Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6de849-e8ea-43db-b88d-285a0858f18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Flow 'volume_create_manager' (979fba1a-e795-4cf5-bcac-a8731dd97467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:08 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f0e8d895-a2c7-45db-91ae-e6d3f0633b8d tempest-AttachVolumeNegativeTest-351245229 None] Created volume successfully. Jun 04 13:24:08 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c 1073741824" returned: 0 in 0.889s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:09 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c Jun 04 13:24:09 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Flow 'volume_create_manager' (0b367127-bfa5-47c8-a879-06de6fc35eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:09 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a2eedd-36af-49be-ab6f-5e6a7ea6e564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c" returned: 0 in 0.837s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.547s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1062018688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=119134e4-3f3d-40d2-a099-f917a6b2fd5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b10d2e63a753425387b587a246991705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:07Z,use_quota=True,user_id='a6a647f9e16b465a80d217eccb1991ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Creating volume 119134e4-3f3d-40d2-a099-f917a6b2fd5a {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:24:09 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a50f572-82e7-4390-82bb-36effd14e401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334ffd5b-d2e8-4465-b6b7-654b8374d7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:09 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a 1073741824 Jun 04 13:24:09 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a2eedd-36af-49be-ab6f-5e6a7ea6e564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1189944532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1927c60-9bdf-4f8d-a58b-a593e17b4fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f88e076a5409695d7224eb275fd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:10Z,use_quota=True,user_id='889207b82d394f90b090742ecbddcdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db629f62-aaea-4f68-9ab6-a8d8564aa735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db629f62-aaea-4f68-9ab6-a8d8564aa735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab79b883-58e9-4700-96e3-6fd46c200936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab79b883-58e9-4700-96e3-6fd46c200936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1927c60-9bdf-4f8d-a58b-a593e17b4fcd', 'volume_name': 'volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f107dd-e71a-47b1-9fc4-c70c92eba313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f107dd-e71a-47b1-9fc4-c70c92eba313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd0a55d-58a1-46e5-a9a9-0d8b3b059918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:09 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Volume b1927c60-9bdf-4f8d-a58b-a593e17b4fcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd', 'volume_size': 1} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:09 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Volume volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c (2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c): created successfully Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334ffd5b-d2e8-4465-b6b7-654b8374d7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (03e8f7c3-30a9-4ca3-95fe-444768f2b521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:09 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8f5460e8-4859-4967-ad1c-fe26fc0341fc tempest-VolumesGetTest-1940282496 None] Created volume successfully. Jun 04 13:24:10 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a 1073741824" returned: 0 in 0.868s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:10 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a Jun 04 13:24:10 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:10 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (754738ca-8d7c-49a3-bd12-677d78cd41b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d446ad2a-2368-4b5f-a58d-32d81992796d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d446ad2a-2368-4b5f-a58d-32d81992796d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-548234240',display_name='tempest-VolumesGetTest-Volume-1046284454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6b4e73-32bc-4830-b5d4-ec55e9668639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:11Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec006031-6aa0-4b0a-8311-bc3d51557275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec006031-6aa0-4b0a-8311-bc3d51557275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c786f784-5468-4f66-ab34-d43b19baabb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c786f784-5468-4f66-ab34-d43b19baabb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af6b4e73-32bc-4830-b5d4-ec55e9668639', 'volume_name': 'volume-af6b4e73-32bc-4830-b5d4-ec55e9668639', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c62474-7712-4057-938a-ac4e99d72724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c62474-7712-4057-938a-ac4e99d72724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5914b9-c59f-4141-8377-9cf075cfc9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:11 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Volume af6b4e73-32bc-4830-b5d4-ec55e9668639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af6b4e73-32bc-4830-b5d4-ec55e9668639', 'volume_size': 1} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:11 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a" returned: 0 in 0.699s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.539s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1189944532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1927c60-9bdf-4f8d-a58b-a593e17b4fcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f88e076a5409695d7224eb275fd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:10Z,use_quota=True,user_id='889207b82d394f90b090742ecbddcdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Creating volume b1927c60-9bdf-4f8d-a58b-a593e17b4fcd {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:24:11 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42df777b-32c3-4025-8729-46c9ef3e9c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b516419-005d-43d6-a758-3e131872ecb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:11 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd 1073741824 Jun 04 13:24:11 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:11 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Volume volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a (119134e4-3f3d-40d2-a099-f917a6b2fd5a): created successfully Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b516419-005d-43d6-a758-3e131872ecb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Flow 'volume_create_manager' (2f343349-72e3-4c5a-9269-3e0a3df8cd06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:11 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-87756ff7-b7b7-44e8-be2b-4d3d9ad55735 tempest-VolumesMetadataTest-674867036 None] Created volume successfully. Jun 04 13:24:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-d38bf7dc-b3f5-4290-8b96-24dd7adaa0c1 req-12955966-8061-4710-8259-2b44a66bfade tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:12 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd 1073741824" returned: 0 in 0.869s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:12 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd Jun 04 13:24:12 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:13 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd" returned: 0 in 0.661s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.988s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-548234240',display_name='tempest-VolumesGetTest-Volume-1046284454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af6b4e73-32bc-4830-b5d4-ec55e9668639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:11Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Creating volume af6b4e73-32bc-4830-b5d4-ec55e9668639 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:24:13 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-af6b4e73-32bc-4830-b5d4-ec55e9668639 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd0a55d-58a1-46e5-a9a9-0d8b3b059918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:13 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-af6b4e73-32bc-4830-b5d4-ec55e9668639 1073741824 Jun 04 13:24:13 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb1d129-adc1-48d8-b287-414813ced35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:13 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Volume volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd (b1927c60-9bdf-4f8d-a58b-a593e17b4fcd): created successfully Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb1d129-adc1-48d8-b287-414813ced35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Flow 'volume_create_manager' (0b367127-bfa5-47c8-a879-06de6fc35eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:13 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-7e7069e0-8112-4a30-9c2c-1bb8bab05f0e tempest-VolumesActionsTest-1738211084 None] Created volume successfully. Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Acquiring lock "cinder-119134e4-3f3d-40d2-a099-f917a6b2fd5a-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Lock "cinder-119134e4-3f3d-40d2-a099-f917a6b2fd5a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Acquiring lock "cinder-quobyte-119134e4-3f3d-40d2-a099-f917a6b2fd5a" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Lock "cinder-quobyte-119134e4-3f3d-40d2-a099-f917a6b2fd5a" acquired by "delete_volume" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[8581fb0d-05ef-4545-8757-5e01e882ca85]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:13 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a Jun 04 13:24:13 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:13 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-af6b4e73-32bc-4830-b5d4-ec55e9668639 1073741824" returned: 0 in 0.886s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-af6b4e73-32bc-4830-b5d4-ec55e9668639 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:14 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-af6b4e73-32bc-4830-b5d4-ec55e9668639 Jun 04 13:24:14 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dfb0aeab-1fe2-4437-b7bb-298ac6ede578 tempest-VolumesActionsTest-1738211084 None] Acquiring lock "cinder-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd" by "attach_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dfb0aeab-1fe2-4437-b7bb-298ac6ede578 tempest-VolumesActionsTest-1738211084 None] Lock "cinder-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd" acquired by "attach_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:14 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-dfb0aeab-1fe2-4437-b7bb-298ac6ede578 tempest-VolumesActionsTest-1738211084 None] Attaching volume b1927c60-9bdf-4f8d-a58b-a593e17b4fcd to instance d519e245-9b31-4dfe-8e20-a066c4691c85 at mountpoint /dev/vdb on host None. Jun 04 13:24:14 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-dfb0aeab-1fe2-4437-b7bb-298ac6ede578 tempest-VolumesActionsTest-1738211084 None] Attach volume completed successfully. Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dfb0aeab-1fe2-4437-b7bb-298ac6ede578 tempest-VolumesActionsTest-1738211084 None] Lock "cinder-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd" released by "attach_volume" :: held 0.138s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:14 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a" returned: 0 in 0.855s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:14 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a Jun 04 13:24:14 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:14 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-af6b4e73-32bc-4830-b5d4-ec55e9668639" returned: 0 in 0.793s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-d38bf7dc-b3f5-4290-8b96-24dd7adaa0c1 req-12955966-8061-4710-8259-2b44a66bfade tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.442s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[e346b7c8-c4d2-429e-94dd-9addc67cd3e3]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-d38bf7dc-b3f5-4290-8b96-24dd7adaa0c1 req-12955966-8061-4710-8259-2b44a66bfade tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5914b9-c59f-4141-8377-9cf075cfc9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af6b4e73-32bc-4830-b5d4-ec55e9668639', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9f164a-b83d-4b67-993b-5b6ad3e23ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:14 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Volume volume-af6b4e73-32bc-4830-b5d4-ec55e9668639 (af6b4e73-32bc-4830-b5d4-ec55e9668639): created successfully Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9f164a-b83d-4b67-993b-5b6ad3e23ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (754738ca-8d7c-49a3-bd12-677d78cd41b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:14 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c37d6776-b77c-4ca6-b035-85cea61062b2 tempest-VolumesGetTest-1940282496 None] Created volume successfully. Jun 04 13:24:15 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa Jun 04 13:24:15 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:15 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-119134e4-3f3d-40d2-a099-f917a6b2fd5a" returned: 0 in 0.696s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Lock "cinder-quobyte-119134e4-3f3d-40d2-a099-f917a6b2fd5a" released by "delete_volume" :: held 1.594s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Created reservations ['93461477-52bf-490c-86ea-ec0649a7105d', 'ef910491-93f2-4fae-af95-89388e73ba4c', '2a439b98-04dc-4a3e-bb01-97ce877f19dc', 'ad56108b-f434-4965-94aa-d3a9962c737c'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:15 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:24:15 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:15 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fd151309-a679-4a9a-aba7-e1b8d89c5d4f tempest-VolumesActionsTest-1210307580 None] Terminate volume connection completed successfully. Jun 04 13:24:15 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-d38bf7dc-b3f5-4290-8b96-24dd7adaa0c1 req-12955966-8061-4710-8259-2b44a66bfade tempest-AttachVolumeNegativeTest-351245229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa" returned: 0 in 0.938s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-d38bf7dc-b3f5-4290-8b96-24dd7adaa0c1 req-12955966-8061-4710-8259-2b44a66bfade tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.962s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-d38bf7dc-b3f5-4290-8b96-24dd7adaa0c1 req-12955966-8061-4710-8259-2b44a66bfade tempest-AttachVolumeNegativeTest-351245229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-e927234c-6d29-443b-9b00-0f845369ccfa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '340e069e-10b2-4c60-bcf3-4ed2ff74e66c', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:24:15 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-d38bf7dc-b3f5-4290-8b96-24dd7adaa0c1 req-12955966-8061-4710-8259-2b44a66bfade tempest-AttachVolumeNegativeTest-351245229 None] attachment_update completed successfully. Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fd151309-a679-4a9a-aba7-e1b8d89c5d4f tempest-VolumesActionsTest-1210307580 None] Acquiring lock "cinder-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd-detach_volume" by "detach_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:15 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fd151309-a679-4a9a-aba7-e1b8d89c5d4f tempest-VolumesActionsTest-1210307580 None] Lock "cinder-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.661s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:24:15 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Deleted volume successfully. Jun 04 13:24:15 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fd151309-a679-4a9a-aba7-e1b8d89c5d4f tempest-VolumesActionsTest-1210307580 None] Detaching volume b1927c60-9bdf-4f8d-a58b-a593e17b4fcd from instance d519e245-9b31-4dfe-8e20-a066c4691c85. Jun 04 13:24:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-21b86c8d-8a8f-48a8-a22c-4bf0c57ee595 tempest-VolumesMetadataTest-674867036 None] Lock "cinder-119134e4-3f3d-40d2-a099-f917a6b2fd5a-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:16 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fd151309-a679-4a9a-aba7-e1b8d89c5d4f tempest-VolumesActionsTest-1210307580 None] Detach volume completed successfully. Jun 04 13:24:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fd151309-a679-4a9a-aba7-e1b8d89c5d4f tempest-VolumesActionsTest-1210307580 None] Lock "cinder-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-caba8166-1e66-4c51-a170-1cdedfc87fbd tempest-VolumesActionsTest-1738211084 None] Acquiring lock "cinder-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd-detach_volume" by "detach_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-af6b4e73-32bc-4830-b5d4-ec55e9668639-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-caba8166-1e66-4c51-a170-1cdedfc87fbd tempest-VolumesActionsTest-1738211084 None] Lock "cinder-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd-detach_volume" acquired by "detach_volume" :: waited 0.060s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:16 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-caba8166-1e66-4c51-a170-1cdedfc87fbd tempest-VolumesActionsTest-1738211084 None] Volume detach called, but volume not attached. Jun 04 13:24:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Lock "cinder-af6b4e73-32bc-4830-b5d4-ec55e9668639-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-caba8166-1e66-4c51-a170-1cdedfc87fbd tempest-VolumesActionsTest-1738211084 None] Lock "cinder-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-quobyte-af6b4e73-32bc-4830-b5d4-ec55e9668639" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-af6b4e73-32bc-4830-b5d4-ec55e9668639" acquired by "delete_volume" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:17 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce9a874-a1ca-4b65-90fa-288f0191ffe0]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-af6b4e73-32bc-4830-b5d4-ec55e9668639 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:17 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-af6b4e73-32bc-4830-b5d4-ec55e9668639 Jun 04 13:24:17 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Acquiring lock "cinder-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Lock "cinder-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Acquiring lock "cinder-quobyte-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Lock "cinder-quobyte-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd" acquired by "delete_volume" :: waited 0.030s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:17 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f815bed-245f-43d7-b6fb-2f8e96d66671]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:18 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd Jun 04 13:24:18 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:18 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-af6b4e73-32bc-4830-b5d4-ec55e9668639" returned: 0 in 1.289s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-af6b4e73-32bc-4830-b5d4-ec55e9668639 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:18 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-af6b4e73-32bc-4830-b5d4-ec55e9668639 Jun 04 13:24:18 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:19 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd" returned: 0 in 1.240s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:19 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd Jun 04 13:24:19 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:19 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-af6b4e73-32bc-4830-b5d4-ec55e9668639" returned: 0 in 0.962s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-af6b4e73-32bc-4830-b5d4-ec55e9668639" released by "delete_volume" :: held 2.303s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Created reservations ['07cf78b1-117f-497b-af38-9052f6de889b', '01fdac92-b598-47e7-bee8-f4c8ecc48c90', 'b98f4e58-5430-421d-a328-62ba2f5196fd', 'b45b733b-5313-479b-a7de-1ba75dab42aa'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:19 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:24:19 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:19 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd" returned: 0 in 0.789s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Lock "cinder-quobyte-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd" released by "delete_volume" :: held 2.162s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Created reservations ['75277af8-1231-4fa4-a7b8-ce610c19d01a', 'b2829f4f-f862-4095-9dcf-c37cfc35673f', 'e1f75ec3-01cb-4d96-ace1-d4483dcab031', 'f38b676e-ffb5-4772-826e-096da4f5f92a'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:20 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:24:20 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:20 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.865s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:24:20 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Deleted volume successfully. Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d56ecef5-6198-49ab-ae7c-68295327f5f3 tempest-VolumesGetTest-1940282496 None] Lock "cinder-af6b4e73-32bc-4830-b5d4-ec55e9668639-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Lock "cinder-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-quobyte-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f12be08-0dc7-46bd-aaf3-430f18711227]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:20 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c Jun 04 13:24:20 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:20 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.724s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:24:20 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Deleted volume successfully. Jun 04 13:24:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-456a430f-c1e6-4007-8442-2588b771842d tempest-VolumesActionsTest-1738211084 None] Lock "cinder-b1927c60-9bdf-4f8d-a58b-a593e17b4fcd-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:21 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c" returned: 0 in 0.958s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:21 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c Jun 04 13:24:21 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:22 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c" returned: 0 in 0.629s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c" released by "delete_volume" :: held 1.640s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:22 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Created reservations ['b90346c9-ba26-411c-8c92-3f5ca74b6ccf', '4c650e35-bbed-4842-8296-4fee935af519', '6b0d2808-34aa-4601-9002-d1c46173f675', '3dc07205-99ad-4192-80dd-2af347f09f78'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:24:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:22 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:24:22 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (1e913057-b4db-425c-b4e7-f8dbb343b06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2804c0c3-ff5b-43e7-b894-0cc3ddf78373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2804c0c3-ff5b-43e7-b894-0cc3ddf78373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1678510365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb33116f-3eab-4bf5-b249-3f7edd16e20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:23Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06f7735-2097-4f0c-88f0-69a877777882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06f7735-2097-4f0c-88f0-69a877777882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a7121d-a0fa-4cab-afb0-66563ad12c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a7121d-a0fa-4cab-afb0-66563ad12c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb33116f-3eab-4bf5-b249-3f7edd16e20c', 'volume_name': 'volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93dac71-1914-485e-aae4-87374fd968e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93dac71-1914-485e-aae4-87374fd968e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7870dc29-3ae5-473a-92a4-319da9d3b32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:23 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Volume eb33116f-3eab-4bf5-b249-3f7edd16e20c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c', 'volume_size': 1} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1678510365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb33116f-3eab-4bf5-b249-3f7edd16e20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:23Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Creating volume eb33116f-3eab-4bf5-b249-3f7edd16e20c {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:24:23 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:23 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c 1073741824 Jun 04 13:24:23 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:23 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.172s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:24:23 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Deleted volume successfully. Jun 04 13:24:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a36f22dc-1a08-4caf-b8c3-69be948b65ef tempest-VolumesGetTest-1940282496 None] Lock "cinder-2f1a2f6b-6eae-4ebe-a178-1d8f3b83966c-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:24 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c 1073741824" returned: 0 in 0.977s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:24 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c Jun 04 13:24:24 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:25 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c" returned: 0 in 0.664s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:24:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7870dc29-3ae5-473a-92a4-319da9d3b32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98092217-8ecf-49de-8d80-720546f0c92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:25 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Volume volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c (eb33116f-3eab-4bf5-b249-3f7edd16e20c): created successfully Jun 04 13:24:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98092217-8ecf-49de-8d80-720546f0c92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (1e913057-b4db-425c-b4e7-f8dbb343b06d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:25 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c6e49b69-7ec8-4bf0-9a75-f283d26657de tempest-VolumesGetTest-1940282496 None] Created volume successfully. Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (05f82cc9-74f5-45df-91f3-be1cf75ef8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4893d8-39e0-4d42-bbf3-6dde5e600b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4893d8-39e0-4d42-bbf3-6dde5e600b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-666697469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=eb33116f-3eab-4bf5-b249-3f7edd16e20c,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:26Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e23d5f9-f25a-4084-be30-2116260b0260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e23d5f9-f25a-4084-be30-2116260b0260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0e622b-bf93-4f60-97eb-135d5ad654f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0e622b-bf93-4f60-97eb-135d5ad654f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020', 'volume_name': 'volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020', 'volume_size': 1, 'source_volid': 'eb33116f-3eab-4bf5-b249-3f7edd16e20c', 'source_volstatus': 'available'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74cffb22-4a36-4cb5-82ae-540c5f34ba02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74cffb22-4a36-4cb5-82ae-540c5f34ba02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc941ded-561b-4a8c-a02b-d5601e44c12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:26 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Volume 8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020', 'volume_size': 1, 'source_volid': 'eb33116f-3eab-4bf5-b249-3f7edd16e20c', 'source_volstatus': 'available'} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:26 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Cloning volume eb33116f-3eab-4bf5-b249-3f7edd16e20c to volume 8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Creating offline snapshot 1ac622eb-594a-4303-8826-3898550e3dff of volume eb33116f-3eab-4bf5-b249-3f7edd16e20c {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e11408e-95ac-41b2-9e56-c2068b9b4bc3]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:26 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c Jun 04 13:24:26 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:27 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c" returned: 0 in 0.991s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:27 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff 1G Jun 04 13:24:27 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:28 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff 1G" returned: 0 in 1.149s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:28 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff Jun 04 13:24:28 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:29 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff" returned: 0 in 0.863s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:29 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff is being set with open permissions: ugo+rw Jun 04 13:24:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:29 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff Jun 04 13:24:29 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:30 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff" returned: 0 in 0.798s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:30 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.info Jun 04 13:24:30 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Flow 'volume_create_manager' (2d409f2a-b39e-4c88-abb0-ae881ac257f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2fa60f6-a2e0-4069-b33c-04ad1455592c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2fa60f6-a2e0-4069-b33c-04ad1455592c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-915238063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ad8831-cb7e-4cc6-94be-ab9ee0704c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f88e076a5409695d7224eb275fd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:30Z,use_quota=True,user_id='889207b82d394f90b090742ecbddcdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2386a987-9e4d-40ed-b8d4-e02fa9b327b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2386a987-9e4d-40ed-b8d4-e02fa9b327b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240854f2-cef1-4502-8439-ddde72778fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (240854f2-cef1-4502-8439-ddde72778fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ad8831-cb7e-4cc6-94be-ab9ee0704c1f', 'volume_name': 'volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238b54be-28e6-41ce-854d-45741c810a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238b54be-28e6-41ce-854d-45741c810a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9efe25-dc89-42ce-9be0-0ba88738027b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:30 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Volume 34ad8831-cb7e-4cc6-94be-ab9ee0704c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f', 'volume_size': 1} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Flow 'volume_create_manager' (4818f19e-6793-46d2-993a-3515b271601d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c892941f-c3b8-46d0-bb06-2428bde0497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c892941f-c3b8-46d0-bb06-2428bde0497e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-262103773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39503f6-1033-47a7-a895-94d94aacb97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda3dd7b269a4fc48bf91b565028766b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:31Z,use_quota=True,user_id='0fcc76482e904d8d856eafd652a126bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bdbc84-9786-4c53-aee1-fcf8db7596f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bdbc84-9786-4c53-aee1-fcf8db7596f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77ae1b5-7078-4b6e-8b15-3fb478713768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77ae1b5-7078-4b6e-8b15-3fb478713768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a39503f6-1033-47a7-a895-94d94aacb97c', 'volume_name': 'volume-a39503f6-1033-47a7-a895-94d94aacb97c', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20ccab3-6ebf-4c80-bf45-dac8dcd7544e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a20ccab3-6ebf-4c80-bf45-dac8dcd7544e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1140624-dab3-471a-939e-a4549d769c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:30 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Volume a39503f6-1033-47a7-a895-94d94aacb97c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a39503f6-1033-47a7-a895-94d94aacb97c', 'volume_size': 1} Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:30 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.info" returned: 0 in 0.874s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:30 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.info is being set with open permissions: ugo+rw Jun 04 13:24:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:31 devstack sudo[95086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.info Jun 04 13:24:31 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:31 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.info" returned: 0 in 0.616s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:31 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-quobyte-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020" by "_copy_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:31 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] snapshot: 1ac622eb-594a-4303-8826-3898550e3dff, volume: 8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020, {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 13:24:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:31 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1fce41-07c9-4213-a078-f652dd718fd6]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:31 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff Jun 04 13:24:31 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:32 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff" returned: 0 in 0.826s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:24:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 13:24:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Creating direct copy from snapshot {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 13:24:32 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[2104c45d-6278-4a40-9e87-78159a1955b4]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:32 devstack sudo[95094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c Jun 04 13:24:32 devstack sudo[95094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:33 devstack sudo[95094]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c" returned: 0 in 0.764s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:33 devstack cinder-volume[86722]: DEBUG cinder.utils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Path /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 not found in is_blk_device check {{(pid=86722) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 13:24:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:33 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 Jun 04 13:24:33 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:38 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020" returned: 0 in 5.475s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:38 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe8cd26-1020-4a21-adeb-529d7fb3f531]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:38 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c Jun 04 13:24:38 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:39 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c" returned: 0 in 0.968s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:39 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:24:39 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Converted 1024.00 MB image at 186.97 MB/s Jun 04 13:24:39 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 is being set with open permissions: ugo+rw Jun 04 13:24:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:39 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 Jun 04 13:24:39 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:40 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020" returned: 0 in 0.678s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020" released by "_copy_volume_from_snapshot" :: held 8.800s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-quobyte-1ac622eb-594a-4303-8826-3898550e3dff" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-1ac622eb-594a-4303-8826-3898550e3dff" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Deleting offline snapshot 1ac622eb-594a-4303-8826-3898550e3dff of volume eb33116f-3eab-4bf5-b249-3f7edd16e20c {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:24:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] snapshot_file for this snap is: volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:24:40 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff1fc46-01dd-4dfc-bdb6-ed6b456cf199]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:40 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff Jun 04 13:24:40 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:41 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff" returned: 0 in 0.709s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:24:41 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9deea0-bd79-4e4a-8e7d-22c5586201db]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:41 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c Jun 04 13:24:41 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:42 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c" returned: 0 in 0.803s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:42 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff Jun 04 13:24:42 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:42 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff" returned: 0 in 0.733s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:42 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff Jun 04 13:24:42 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:43 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c.1ac622eb-594a-4303-8826-3898550e3dff" returned: 0 in 0.704s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-1ac622eb-594a-4303-8826-3898550e3dff" released by "_delete_snapshot" :: held 3.064s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.385s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.897s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-915238063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ad8831-cb7e-4cc6-94be-ab9ee0704c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f88e076a5409695d7224eb275fd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:30Z,use_quota=True,user_id='889207b82d394f90b090742ecbddcdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Creating volume 34ad8831-cb7e-4cc6-94be-ab9ee0704c1f {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:24:43 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:43 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f 1073741824 Jun 04 13:24:43 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc941ded-561b-4a8c-a02b-d5601e44c12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020', 'volume_size': 1, 'source_volid': 'eb33116f-3eab-4bf5-b249-3f7edd16e20c', 'source_volstatus': 'available'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c543cc3-0133-430e-8fd5-84d044c8f614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:43 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Volume volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 (8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020): created successfully Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c543cc3-0133-430e-8fd5-84d044c8f614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (05f82cc9-74f5-45df-91f3-be1cf75ef8ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:43 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-dcbc9c8e-b330-410b-b77f-f4f3c7dfe2a7 tempest-VolumesGetTest-1940282496 None] Created volume successfully. Jun 04 13:24:44 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f 1073741824" returned: 0 in 0.998s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:44 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f Jun 04 13:24:44 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:45 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f" returned: 0 in 0.704s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.565s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-262103773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a39503f6-1033-47a7-a895-94d94aacb97c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda3dd7b269a4fc48bf91b565028766b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:31Z,use_quota=True,user_id='0fcc76482e904d8d856eafd652a126bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Creating volume a39503f6-1033-47a7-a895-94d94aacb97c {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:24:45 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9efe25-dc89-42ce-9be0-0ba88738027b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:45 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c 1073741824 Jun 04 13:24:45 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475ee17e-14cf-4309-b245-ffe6ae3e716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:45 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Volume volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f (34ad8831-cb7e-4cc6-94be-ab9ee0704c1f): created successfully Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475ee17e-14cf-4309-b245-ffe6ae3e716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Flow 'volume_create_manager' (2d409f2a-b39e-4c88-abb0-ae881ac257f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-893a93ad-c447-4810-a596-2351cfcf1142 tempest-VolumesActionsTest-1738211084 None] Created volume successfully. Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (2f95d54b-8897-4439-b7a6-9c0041b313a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff01d89b-6b12-4e69-a57b-c2e51c07d96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff01d89b-6b12-4e69-a57b-c2e51c07d96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1250347331',display_name='tempest-VolumesGetTest-Volume-1077495528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7940001-fcd9-4af0-bf87-ebc15f6c03ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:46Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a90b584-7ef6-43c1-8a81-a7edb4d481f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a90b584-7ef6-43c1-8a81-a7edb4d481f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535b5cd8-928f-4ce0-a0b2-6ac6e0612745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535b5cd8-928f-4ce0-a0b2-6ac6e0612745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7940001-fcd9-4af0-bf87-ebc15f6c03ee', 'volume_name': 'volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9300eb6c-3220-48fc-8bd6-2ff5660a045b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9300eb6c-3220-48fc-8bd6-2ff5660a045b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b6b337-0ef9-4bd5-8106-809bddbb9a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:46 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Volume c7940001-fcd9-4af0-bf87-ebc15f6c03ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee', 'volume_size': 1} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Acquiring lock "cinder-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Lock "cinder-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Acquiring lock "cinder-quobyte-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Lock "cinder-quobyte-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f" acquired by "delete_volume" :: waited 0.031s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[786bff83-005c-4153-a39a-884df5e628f0]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:46 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c 1073741824" returned: 0 in 1.278s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:46 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f Jun 04 13:24:46 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:46 devstack sudo[95298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c Jun 04 13:24:46 devstack sudo[95298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:47 devstack sudo[95298]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c" returned: 0 in 0.745s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1250347331',display_name='tempest-VolumesGetTest-Volume-1077495528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7940001-fcd9-4af0-bf87-ebc15f6c03ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:46Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Creating volume c7940001-fcd9-4af0-bf87-ebc15f6c03ee {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:47 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:24:47 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f" returned: 0 in 0.936s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:47 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee 1073741824 Jun 04 13:24:47 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1140624-dab3-471a-939e-a4549d769c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a39503f6-1033-47a7-a895-94d94aacb97c', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcca9052-3fee-4525-a9b2-ee6629f1253d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:47 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Volume volume-a39503f6-1033-47a7-a895-94d94aacb97c (a39503f6-1033-47a7-a895-94d94aacb97c): created successfully Jun 04 13:24:47 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f Jun 04 13:24:47 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcca9052-3fee-4525-a9b2-ee6629f1253d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Flow 'volume_create_manager' (4818f19e-6793-46d2-993a-3515b271601d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:47 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1753ede2-897b-43ba-bb8e-49dd172fe0a9 tempest-VolumesActionsTest-622811305 None] Created volume successfully. Jun 04 13:24:48 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f" returned: 0 in 0.786s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Lock "cinder-quobyte-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f" released by "delete_volume" :: held 1.790s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:48 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee 1073741824" returned: 0 in 0.861s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:48 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Created reservations ['13636bd9-becc-45b8-8982-e7f23d34c49a', '921d1fcc-57d2-47fe-b5c9-ac0fa6ab2503', '0ffe6a8b-e623-4e33-b9fc-70fa6ccdc8a0', '0f8601af-b7c2-4505-bb66-78a19927f768'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:24:48 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee Jun 04 13:24:48 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:48 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:24:48 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:49 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee" returned: 0 in 1.166s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b6b337-0ef9-4bd5-8106-809bddbb9a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0cc8300-c65d-4c8a-8fb7-fd8916746225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:49 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Volume volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee (c7940001-fcd9-4af0-bf87-ebc15f6c03ee): created successfully Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0cc8300-c65d-4c8a-8fb7-fd8916746225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (2f95d54b-8897-4439-b7a6-9c0041b313a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Flow 'volume_create_manager' (4c9ec9ce-3bb0-4bfd-b72f-365c16362d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27abf16-5742-4f4a-9176-cd19a087b0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:49 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-18a3f57f-ce39-47b8-abf0-18ceee41a88f tempest-VolumesGetTest-1940282496 None] Created volume successfully. Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27abf16-5742-4f4a-9176-cd19a087b0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1599312208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ea6085-2c7c-4416-bf56-ac82ec5bee4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f88e076a5409695d7224eb275fd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:50Z,use_quota=True,user_id='889207b82d394f90b090742ecbddcdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b93df2d-c016-4bd8-b353-81fb95b269ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b93df2d-c016-4bd8-b353-81fb95b269ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce41abd-c108-4645-8984-5203f0210898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce41abd-c108-4645-8984-5203f0210898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8ea6085-2c7c-4416-bf56-ac82ec5bee4e', 'volume_name': 'volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39273313-0a0b-4ea7-ad22-7ebe784ef2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39273313-0a0b-4ea7-ad22-7ebe784ef2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066c6d62-a554-4b8c-978d-6b3acd3e9879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:49 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Volume b8ea6085-2c7c-4416-bf56-ac82ec5bee4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e', 'volume_size': 1} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1599312208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ea6085-2c7c-4416-bf56-ac82ec5bee4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f88e076a5409695d7224eb275fd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:50Z,use_quota=True,user_id='889207b82d394f90b090742ecbddcdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Creating volume b8ea6085-2c7c-4416-bf56-ac82ec5bee4e {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:49 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:24:49 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.285s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:24:49 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Deleted volume successfully. Jun 04 13:24:49 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e 1073741824 Jun 04 13:24:49 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e0e8af54-e98c-4eb0-99ab-83c36a525a01 tempest-VolumesActionsTest-1210307580 None] Lock "cinder-34ad8831-cb7e-4cc6-94be-ab9ee0704c1f-delete_volume" released by "delete_volume" :: held 3.491s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-c7940001-fcd9-4af0-bf87-ebc15f6c03ee-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Lock "cinder-c7940001-fcd9-4af0-bf87-ebc15f6c03ee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-quobyte-c7940001-fcd9-4af0-bf87-ebc15f6c03ee" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-c7940001-fcd9-4af0-bf87-ebc15f6c03ee" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:50 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[415db02f-028b-4d33-8c30-52253e497472]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:50 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee Jun 04 13:24:50 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:50 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e 1073741824" returned: 0 in 1.033s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:50 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e Jun 04 13:24:50 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:51 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee" returned: 0 in 0.831s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:51 devstack sudo[95338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee Jun 04 13:24:51 devstack sudo[95338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:51 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e" returned: 0 in 0.719s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:24:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:51 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=84,cinder:UPDATE=108,cinder:INSERT=29,cinder:DELETE=10 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:24:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066c6d62-a554-4b8c-978d-6b3acd3e9879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ecab06-1349-47ac-a786-d0af95d3d81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:51 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=119,cinder:DELETE=10,cinder:SELECT=89,cinder:INSERT=23 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:24:51 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Volume volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e (b8ea6085-2c7c-4416-bf56-ac82ec5bee4e): created successfully Jun 04 13:24:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ecab06-1349-47ac-a786-d0af95d3d81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Flow 'volume_create_manager' (4c9ec9ce-3bb0-4bfd-b72f-365c16362d39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c094ce26-aec2-4911-a3f9-096ce62c0e6d tempest-VolumesActionsTest-1738211084 None] Created volume successfully. Jun 04 13:24:52 devstack sudo[95338]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c7940001-fcd9-4af0-bf87-ebc15f6c03ee" returned: 0 in 0.682s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-c7940001-fcd9-4af0-bf87-ebc15f6c03ee" released by "delete_volume" :: held 1.557s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:52 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Created reservations ['53bee52b-44f1-4fb4-8040-d6360c406621', '98b29b39-c340-4359-ab34-490f7f9a3c46', '3fc6b254-ba36-4309-901d-ebe5cfad6463', 'a006f5fd-b05a-40b8-96f3-a9ce4f187fee'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:24:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:52 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:24:52 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Lock "cinder-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:53 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.676s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:24:53 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Deleted volume successfully. Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Acquiring lock "cinder-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-quobyte-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35c36cb7-5f7f-4317-a5e8-8f8f1a6f2344 tempest-VolumesGetTest-1940282496 None] Lock "cinder-c7940001-fcd9-4af0-bf87-ebc15f6c03ee-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Lock "cinder-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020" acquired by "delete_volume" :: waited 0.030s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6c3631-e64b-4dc2-9e92-db663a12ec2e]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Acquiring lock "cinder-quobyte-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Lock "cinder-quobyte-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[02951269-5f05-4d9a-8b3e-1a74f1390cae]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:53 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 Jun 04 13:24:53 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:53 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e Jun 04 13:24:53 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:53 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020" returned: 0 in 0.770s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:53 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020 Jun 04 13:24:53 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:53 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e" returned: 0 in 0.742s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:54 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e Jun 04 13:24:54 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:54 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020" returned: 0 in 0.629s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020" released by "delete_volume" :: held 1.461s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:54 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e" returned: 0 in 0.633s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Lock "cinder-quobyte-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e" released by "delete_volume" :: held 1.448s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Created reservations ['4fbc664b-a6da-4162-9c3d-7e0a7abdf9e4', '335f0838-cffa-4dc8-9c65-e9251816270c', 'b026c74e-cdd0-4f62-8b78-f1c478f2575e', 'ce119892-7493-4cf6-9bb2-7aee130f68a0'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Created reservations ['2976195b-c826-4488-9cd9-59019e3732e9', 'bce23e41-7fa2-48af-b9b5-6ca8d26a1fbc', '1f5c5d3b-f0b5-485a-a046-e41fb9284317', 'e68be79a-016e-4b1a-a5d7-9187c6fc95b0'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:54 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:24:54 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:54 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:24:54 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-eb33116f-3eab-4bf5-b249-3f7edd16e20c-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:55 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.708s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:55 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:24:55 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Deleted volume successfully. Jun 04 13:24:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Lock "cinder-eb33116f-3eab-4bf5-b249-3f7edd16e20c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c721a81f-1c29-4f4d-b7d2-55359cec3e63 tempest-VolumesGetTest-1940282496 None] Lock "cinder-8b08f7a5-0b30-4cba-ab50-ebaf3e7f8020-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-quobyte-eb33116f-3eab-4bf5-b249-3f7edd16e20c" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-eb33116f-3eab-4bf5-b249-3f7edd16e20c" acquired by "delete_volume" :: waited 0.014s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:55 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[89143ea3-ee2e-46f3-a62c-fb567c9bc985]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:55 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c Jun 04 13:24:55 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:55 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.977s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:55 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:24:55 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Deleted volume successfully. Jun 04 13:24:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-832ec659-dd4a-464d-a6f4-6d7d9791a1e1 tempest-VolumesActionsTest-1210307580 None] Lock "cinder-b8ea6085-2c7c-4416-bf56-ac82ec5bee4e-delete_volume" released by "delete_volume" :: held 2.734s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Flow 'volume_create_manager' (77d252d1-8c34-4d51-93d2-9beb4ea93878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8d9ef0-1897-442f-a231-74bc38f4bba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8d9ef0-1897-442f-a231-74bc38f4bba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1652368023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b72cbc7-101e-49cb-9e29-b5c5fa55fab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f88e076a5409695d7224eb275fd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:56Z,use_quota=True,user_id='889207b82d394f90b090742ecbddcdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdee854-3bf2-4e17-9f4d-54ae0d4f6b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdee854-3bf2-4e17-9f4d-54ae0d4f6b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04207dd8-ca18-4fb8-a6ba-8bb92d046ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04207dd8-ca18-4fb8-a6ba-8bb92d046ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b72cbc7-101e-49cb-9e29-b5c5fa55fab3', 'volume_name': 'volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a14b0c-4eee-47ff-80e0-391de554881f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a14b0c-4eee-47ff-80e0-391de554881f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70721951-be72-4a30-82c8-13148546e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:56 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Volume 1b72cbc7-101e-49cb-9e29-b5c5fa55fab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3', 'volume_size': 1} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1652368023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b72cbc7-101e-49cb-9e29-b5c5fa55fab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f88e076a5409695d7224eb275fd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:56Z,use_quota=True,user_id='889207b82d394f90b090742ecbddcdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Creating volume 1b72cbc7-101e-49cb-9e29-b5c5fa55fab3 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:24:56 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:56 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3 1073741824 Jun 04 13:24:56 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:56 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c" returned: 0 in 0.840s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:56 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c Jun 04 13:24:56 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:57 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3 1073741824" returned: 0 in 0.929s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:57 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3 Jun 04 13:24:57 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:57 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-eb33116f-3eab-4bf5-b249-3f7edd16e20c" returned: 0 in 0.729s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-eb33116f-3eab-4bf5-b249-3f7edd16e20c" released by "delete_volume" :: held 1.665s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Created reservations ['534b019b-ad8b-4312-bd36-3cd73c47c5e0', '3a27e873-fd83-4708-8b44-55686892f814', 'b010c894-802f-4378-9c46-894215a6811d', 'a04385cd-c050-438f-a63c-84166cbcf8e3'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:57 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:24:57 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:57 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3" returned: 0 in 0.638s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70721951-be72-4a30-82c8-13148546e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441c075f-8caf-4319-a997-1e31a3a8b6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:57 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Volume volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3 (1b72cbc7-101e-49cb-9e29-b5c5fa55fab3): created successfully Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441c075f-8caf-4319-a997-1e31a3a8b6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Flow 'volume_create_manager' (77d252d1-8c34-4d51-93d2-9beb4ea93878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:57 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-058dbe60-a2c3-405a-a5cd-8bac69929871 tempest-VolumesActionsTest-1738211084 None] Created volume successfully. Jun 04 13:24:58 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.649s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:24:58 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Deleted volume successfully. Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-df1b9cd7-c3fe-4795-98e2-4e3630577380 tempest-VolumesGetTest-1940282496 None] Lock "cinder-eb33116f-3eab-4bf5-b249-3f7edd16e20c-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Acquiring lock "cinder-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Lock "cinder-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Acquiring lock "cinder-quobyte-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (1f0af14a-df0d-4ae3-ae85-108b43c07a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1265666-7ab5-40fc-9136-32d52eda6317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Lock "cinder-quobyte-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3" acquired by "delete_volume" :: waited 0.062s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1265666-7ab5-40fc-9136-32d52eda6317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-462111911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8e42d6-5a43-473a-a40a-27593c777801,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:58Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed90669-7de4-4f05-a862-49ceea3977be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed90669-7de4-4f05-a862-49ceea3977be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3f0d68-ee73-45b4-9af6-8ceda7a5d177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.image.glance [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Creating Keystone auth plugin from conf {{(pid=86722) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0791661-3a85-4e6b-9150-65690af40145]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:58 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3 Jun 04 13:24:58 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3f0d68-ee73-45b4-9af6-8ceda7a5d177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bd8e42d6-5a43-473a-a40a-27593c777801', 'volume_name': 'volume-bd8e42d6-5a43-473a-a40a-27593c777801', 'volume_size': 1, 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6c11a9aab9d47a1bd95d90c20211b72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'created_at': datetime.datetime(2026, 6, 4, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2c1662-ac5c-4701-82fe-44e73ab588d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2c1662-ac5c-4701-82fe-44e73ab588d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ace65fc-253b-4722-920d-42d5c8b81ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:24:58 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Volume bd8e42d6-5a43-473a-a40a-27593c777801: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bd8e42d6-5a43-473a-a40a-27593c777801', 'volume_size': 1, 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6c11a9aab9d47a1bd95d90c20211b72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'created_at': datetime.datetime(2026, 6, 4, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 13:24:58 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Trying to clone bd8e42d6-5a43-473a-a40a-27593c777801 from image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]). {{(pid=86722) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 13:24:59 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:59 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 13:24:59 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Image download 20.69 MB at 20.69 MB/s Jun 04 13:24:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3" returned: 0 in 0.775s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:24:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:59 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3 Jun 04 13:24:59 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:59 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2c99d8-d6ef-4edb-9e17-303afaa534b2]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:24:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:24:59 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD Jun 04 13:24:59 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:24:59 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Jun 04 13:24:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3" returned: 0 in 0.662s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Lock "cinder-quobyte-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3" released by "delete_volume" :: held 1.513s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Created reservations ['deaef513-0b7a-4d29-93f2-9e651fbd47ae', 'fe4c4f97-947a-44ca-9783-ca2f39170cdc', '66fa547b-081e-4045-a77c-d6394075574f', 'ddd0a038-66ce-45b4-8eb1-0f9a95d8abcc'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:00 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD" returned: 0 in 0.791s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Temporary image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d is fetched for user 5135b263209c40158b84fc0d6e5911c0. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 13:25:00 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:25:00 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd44762-ff99-4b0b-bb65-97987531357c]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:00 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD Jun 04 13:25:00 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:00 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.672s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:25:00 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Deleted volume successfully. Jun 04 13:25:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4a16f159-72a9-44bf-af63-ae9ca807eeef tempest-VolumesActionsTest-1210307580 None] Lock "cinder-1b72cbc7-101e-49cb-9e29-b5c5fa55fab3-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:01 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD" returned: 0 in 0.840s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-462111911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8e42d6-5a43-473a-a40a-27593c777801,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:24:58Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Creating volume bd8e42d6-5a43-473a-a40a-27593c777801 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:25:01 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:01 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 1073741824 Jun 04 13:25:01 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Flow 'volume_create_manager' (6286de73-e4e9-408f-94d8-52cba6e8828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a012269-2098-4a0a-b40a-3bd0a5d248eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a012269-2098-4a0a-b40a-3bd0a5d248eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-663381026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abdbedd6-5ac3-46f6-9376-54e700630631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f88e076a5409695d7224eb275fd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:01Z,use_quota=True,user_id='889207b82d394f90b090742ecbddcdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b38122-b7bc-43c4-ab08-ef59e6ad286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b38122-b7bc-43c4-ab08-ef59e6ad286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2152d27-592c-4937-b68b-d4ec210bb109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2152d27-592c-4937-b68b-d4ec210bb109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abdbedd6-5ac3-46f6-9376-54e700630631', 'volume_name': 'volume-abdbedd6-5ac3-46f6-9376-54e700630631', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e3da71-ef1c-407f-9aa5-02e47d4e2aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e3da71-ef1c-407f-9aa5-02e47d4e2aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b355fd-aed5-4df7-bfeb-4d4123ec6e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:01 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Volume abdbedd6-5ac3-46f6-9376-54e700630631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abdbedd6-5ac3-46f6-9376-54e700630631', 'volume_size': 1} Jun 04 13:25:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:02 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 1073741824" returned: 0 in 1.430s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:02 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 Jun 04 13:25:02 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:03 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801" returned: 0 in 0.916s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.436s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.172s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-663381026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abdbedd6-5ac3-46f6-9376-54e700630631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f88e076a5409695d7224eb275fd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:01Z,use_quota=True,user_id='889207b82d394f90b090742ecbddcdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Creating volume abdbedd6-5ac3-46f6-9376-54e700630631 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:25:03 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-abdbedd6-5ac3-46f6-9376-54e700630631 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:03 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-abdbedd6-5ac3-46f6-9376-54e700630631 1073741824 Jun 04 13:25:03 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Attempting download of 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d ((None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}])) to volume bd8e42d6-5a43-473a-a40a-27593c777801. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[946f5a1d-bd36-4eed-be69-3af28094c1ad]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_nclvu9gv {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:03 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_nclvu9gv Jun 04 13:25:03 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:25:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:04 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:25:04 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:05 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_nclvu9gv" returned: 0 in 1.438s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_nclvu9gv {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:05 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_nclvu9gv Jun 04 13:25:05 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:05 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-abdbedd6-5ac3-46f6-9376-54e700630631 1073741824" returned: 0 in 1.721s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-abdbedd6-5ac3-46f6-9376-54e700630631 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:05 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-abdbedd6-5ac3-46f6-9376-54e700630631 Jun 04 13:25:05 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:05 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.472s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:05 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:25:05 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:25:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:25:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:25:06 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_nclvu9gv" returned: 1 in 1.065s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_nclvu9gv' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c483ade-94d1-4c4b-b1bd-10ba03670c23]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:06 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-abdbedd6-5ac3-46f6-9376-54e700630631" returned: 0 in 0.886s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] <== create_volume: return (2673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.678s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b355fd-aed5-4df7-bfeb-4d4123ec6e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abdbedd6-5ac3-46f6-9376-54e700630631', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596e9ab6-77ba-4f1c-9948-aac2d71ac496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:06 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Volume volume-abdbedd6-5ac3-46f6-9376-54e700630631 (abdbedd6-5ac3-46f6-9376-54e700630631): created successfully Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596e9ab6-77ba-4f1c-9948-aac2d71ac496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Flow 'volume_create_manager' (6286de73-e4e9-408f-94d8-52cba6e8828b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:06 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-da4e801b-2d94-497b-af39-b1eccc2973d8 tempest-VolumesActionsTest-1738211084 None] Created volume successfully. Jun 04 13:25:06 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD Jun 04 13:25:06 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f3f72625-abec-4534-aacb-2a5e7595f30b tempest-VolumesActionsTest-622811305 None] Acquiring lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c" by "attach_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:06 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f3f72625-abec-4534-aacb-2a5e7595f30b tempest-VolumesActionsTest-622811305 None] Lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c" acquired by "attach_volume" :: waited 0.035s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:07 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f3f72625-abec-4534-aacb-2a5e7595f30b tempest-VolumesActionsTest-622811305 None] Attaching volume a39503f6-1033-47a7-a895-94d94aacb97c to instance 599fd689-5208-4499-969c-58fcb9a91def at mountpoint /dev/vdb on host None. Jun 04 13:25:07 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f3f72625-abec-4534-aacb-2a5e7595f30b tempest-VolumesActionsTest-622811305 None] Attach volume completed successfully. Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f3f72625-abec-4534-aacb-2a5e7595f30b tempest-VolumesActionsTest-622811305 None] Lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c" released by "attach_volume" :: held 0.245s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Acquiring lock "cinder-abdbedd6-5ac3-46f6-9376-54e700630631-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Lock "cinder-abdbedd6-5ac3-46f6-9376-54e700630631-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Acquiring lock "cinder-quobyte-abdbedd6-5ac3-46f6-9376-54e700630631" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Lock "cinder-quobyte-abdbedd6-5ac3-46f6-9376-54e700630631" acquired by "delete_volume" :: waited 0.034s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2af6ff-ca85-4da6-a87f-4b13a3d9c5ac]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-abdbedd6-5ac3-46f6-9376-54e700630631 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-232f5b5e-dac4-4c9b-87f4-58d62f9a0069 tempest-VolumesActionsTest-622811305 None] Acquiring lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c-detach_volume" by "detach_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-232f5b5e-dac4-4c9b-87f4-58d62f9a0069 tempest-VolumesActionsTest-622811305 None] Lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:07 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-232f5b5e-dac4-4c9b-87f4-58d62f9a0069 tempest-VolumesActionsTest-622811305 None] Detaching volume a39503f6-1033-47a7-a895-94d94aacb97c from instance 599fd689-5208-4499-969c-58fcb9a91def. Jun 04 13:25:07 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-abdbedd6-5ac3-46f6-9376-54e700630631 Jun 04 13:25:07 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:07 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-232f5b5e-dac4-4c9b-87f4-58d62f9a0069 tempest-VolumesActionsTest-622811305 None] Detach volume completed successfully. Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-232f5b5e-dac4-4c9b-87f4-58d62f9a0069 tempest-VolumesActionsTest-622811305 None] Lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:07 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD" returned: 0 in 1.658s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d was qcow2, converting to raw {{(pid=86722) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 13:25:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:07 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 Jun 04 13:25:07 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:09 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-abdbedd6-5ac3-46f6-9376-54e700630631" returned: 0 in 1.606s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-abdbedd6-5ac3-46f6-9376-54e700630631 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:09 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-abdbedd6-5ac3-46f6-9376-54e700630631 Jun 04 13:25:09 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:10 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-abdbedd6-5ac3-46f6-9376-54e700630631" returned: 0 in 1.141s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:10 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Lock "cinder-quobyte-abdbedd6-5ac3-46f6-9376-54e700630631" released by "delete_volume" :: held 2.853s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:10 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Created reservations ['bf094b87-9f8e-46a4-ae69-948f37f9e3ff', 'e13f42ac-84f1-4af9-a6e5-fc6c5b76e60a', '83b8b573-a668-4921-9952-a70f601a2c47', '64eb9584-6cfa-4be6-a150-7f6ecd2bb101'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:25:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:10 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:10 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:10 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:25:10 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:10 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801" returned: 0 in 3.048s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:10 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_emza_sb8devstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:25:10 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Converted 112.00 MB image at 36.73 MB/s Jun 04 13:25:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:10 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 1G Jun 04 13:25:10 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:11 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.699s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:25:11 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Deleted volume successfully. Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d7c1742d-d99e-401f-b8f7-a04bd9584050 tempest-VolumesActionsTest-1210307580 None] Lock "cinder-abdbedd6-5ac3-46f6-9376-54e700630631-delete_volume" released by "delete_volume" :: held 3.954s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Flow 'volume_create_manager' (3d4bc13a-f1ea-43e3-a4d2-67230c668820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e485f746-caff-4a49-8317-e816abcc4f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e485f746-caff-4a49-8317-e816abcc4f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1792942420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f88e076a5409695d7224eb275fd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:11Z,use_quota=True,user_id='889207b82d394f90b090742ecbddcdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49131239-e411-404a-a6ee-750087fa91d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49131239-e411-404a-a6ee-750087fa91d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5c1984-d917-4ec2-98f2-b43e55461835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5c1984-d917-4ec2-98f2-b43e55461835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63', 'volume_name': 'volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00aa10aa-1c54-4d9a-b2c0-04a631d30b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00aa10aa-1c54-4d9a-b2c0-04a631d30b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0907135d-9675-41a4-9afd-6ff742b1ea89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:11 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Volume 85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63', 'volume_size': 1} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1792942420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f7f88e076a5409695d7224eb275fd26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:11Z,use_quota=True,user_id='889207b82d394f90b090742ecbddcdc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Creating volume 85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:25:11 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:11 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63 1073741824 Jun 04 13:25:11 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:11 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 1G" returned: 0 in 0.795s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d361c02f-dc8b-4872-9aed-fa9b2ecfac5a]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:11 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 Jun 04 13:25:11 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:12 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63 1073741824" returned: 0 in 0.880s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:12 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63 Jun 04 13:25:12 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:12 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801" returned: 0 in 0.864s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:12 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 Jun 04 13:25:12 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:13 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63" returned: 0 in 0.715s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0907135d-9675-41a4-9afd-6ff742b1ea89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b2226e-3dca-4756-967e-bd6a86768147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:13 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Volume volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63 (85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63): created successfully Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67b2226e-3dca-4756-967e-bd6a86768147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Flow 'volume_create_manager' (3d4bc13a-f1ea-43e3-a4d2-67230c668820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:13 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ae927100-7daf-4df6-a249-9ad6e3838b44 tempest-VolumesActionsTest-1738211084 None] Created volume successfully. Jun 04 13:25:13 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801" returned: 1 in 0.723s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Downloaded image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d ((None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}])) to volume bd8e42d6-5a43-473a-a40a-27593c777801 successfully. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Temporary image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d for user 5135b263209c40158b84fc0d6e5911c0 is deleted. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Marking volume bd8e42d6-5a43-473a-a40a-27593c777801 as bootable. {{(pid=86722) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Copying metadata from image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d to bd8e42d6-5a43-473a-a40a-27593c777801. {{(pid=86722) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Creating volume glance metadata for volume bd8e42d6-5a43-473a-a40a-27593c777801 backed by image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86722) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ace65fc-253b-4722-920d-42d5c8b81ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd8e42d6-5a43-473a-a40a-27593c777801', 'volume_size': 1, 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6c11a9aab9d47a1bd95d90c20211b72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'created_at': datetime.datetime(2026, 6, 4, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2bbe4f6-f35f-4c2b-b47b-52acfaa4a4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:13 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Volume volume-bd8e42d6-5a43-473a-a40a-27593c777801 (bd8e42d6-5a43-473a-a40a-27593c777801): created successfully Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2bbe4f6-f35f-4c2b-b47b-52acfaa4a4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (1f0af14a-df0d-4ae3-ae85-108b43c07a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:13 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f2ddbb4f-28d5-4d95-ad0e-f361b236ba66 tempest-VolumesGetTest-1940282496 None] Created volume successfully. Jun 04 13:25:13 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Acquiring lock "cinder-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Lock "cinder-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Acquiring lock "cinder-quobyte-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Lock "cinder-quobyte-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63" acquired by "delete_volume" :: waited 0.033s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:14 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f453b4bd-015a-48b4-932f-4d397629cb63]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:14 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63 Jun 04 13:25:14 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:14 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:25:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (4cc04b7d-75f4-41c9-b3c9-e47ef42b259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e34d42c-6dbe-4610-b1b5-ad71522aa42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e34d42c-6dbe-4610-b1b5-ad71522aa42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1944505302',display_name='tempest-VolumesGetTest-Volume-1121502134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efb4413-027c-40e2-93d5-676e050ae381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:15Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0db36c5-b146-4575-a641-ec84b87b7bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0db36c5-b146-4575-a641-ec84b87b7bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0185dffb-0ba8-4c53-b946-759107610f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0185dffb-0ba8-4c53-b946-759107610f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1efb4413-027c-40e2-93d5-676e050ae381', 'volume_name': 'volume-1efb4413-027c-40e2-93d5-676e050ae381', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b1bae9-7b5e-45c1-9d5e-b1babda4274b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b1bae9-7b5e-45c1-9d5e-b1babda4274b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:15 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d588d90a-375a-406c-a4fe-c9103ca39035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:15 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Volume 1efb4413-027c-40e2-93d5-676e050ae381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1efb4413-027c-40e2-93d5-676e050ae381', 'volume_size': 1} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1944505302',display_name='tempest-VolumesGetTest-Volume-1121502134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efb4413-027c-40e2-93d5-676e050ae381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c529c78c952845429b49e0f0dfda57a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:15Z,use_quota=True,user_id='5135b263209c40158b84fc0d6e5911c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Creating volume 1efb4413-027c-40e2-93d5-676e050ae381 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:25:15 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1efb4413-027c-40e2-93d5-676e050ae381 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63" returned: 0 in 0.929s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:15 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1efb4413-027c-40e2-93d5-676e050ae381 1073741824 Jun 04 13:25:15 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:15 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63 Jun 04 13:25:15 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:15 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63" returned: 0 in 0.701s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Lock "cinder-quobyte-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63" released by "delete_volume" :: held 1.683s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Created reservations ['aa1830f2-b996-4a95-a13f-eb6bd99d34bd', '738d1d6c-f94a-4db8-9d49-0ce96feebcc2', '6746c885-bb34-42aa-bee4-d4d3b33aba75', '1a3a2a60-13a3-4913-ad4d-e7fbe8b5259a'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:15 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1efb4413-027c-40e2-93d5-676e050ae381 1073741824" returned: 0 in 0.874s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:15 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:25:15 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1efb4413-027c-40e2-93d5-676e050ae381 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:15 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1efb4413-027c-40e2-93d5-676e050ae381 Jun 04 13:25:15 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:16 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.663s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:16 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:25:16 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Deleted volume successfully. Jun 04 13:25:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f55561d9-9383-4fc3-a0e4-9e0a615e68ec tempest-VolumesActionsTest-1738211084 None] Lock "cinder-85c9ddd8-dbbe-41ab-9e40-a6a48cd1ae63-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:16 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1efb4413-027c-40e2-93d5-676e050ae381" returned: 0 in 0.666s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:16 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:25:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d588d90a-375a-406c-a4fe-c9103ca39035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efb4413-027c-40e2-93d5-676e050ae381', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654ec196-04d3-4b8b-9476-2e71bcd57c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:16 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Volume volume-1efb4413-027c-40e2-93d5-676e050ae381 (1efb4413-027c-40e2-93d5-676e050ae381): created successfully Jun 04 13:25:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (654ec196-04d3-4b8b-9476-2e71bcd57c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Flow 'volume_create_manager' (4cc04b7d-75f4-41c9-b3c9-e47ef42b259e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:16 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-150543f3-9629-49c3-91a4-4b9fc0e425c2 tempest-VolumesGetTest-1940282496 None] Created volume successfully. Jun 04 13:25:16 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-69df3079-e9fc-48e2-8c73-2bdded32408c req-a2d4ec73-a937-45eb-8efe-261abcb09668 tempest-AttachVolumeNegativeTest-351245229 None] Terminate volume connection completed successfully. Jun 04 13:25:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-69df3079-e9fc-48e2-8c73-2bdded32408c req-a2d4ec73-a937-45eb-8efe-261abcb09668 tempest-AttachVolumeNegativeTest-351245229 None] Deleting attachment 340e069e-10b2-4c60-bcf3-4ed2ff74e66c. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:25:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-1efb4413-027c-40e2-93d5-676e050ae381-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Lock "cinder-1efb4413-027c-40e2-93d5-676e050ae381-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-quobyte-1efb4413-027c-40e2-93d5-676e050ae381" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-1efb4413-027c-40e2-93d5-676e050ae381" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:17 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f43954-0cdf-46da-a4ce-1556b3bf3c11]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1efb4413-027c-40e2-93d5-676e050ae381 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:17 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1efb4413-027c-40e2-93d5-676e050ae381 Jun 04 13:25:17 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:18 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1efb4413-027c-40e2-93d5-676e050ae381" returned: 0 in 0.815s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1efb4413-027c-40e2-93d5-676e050ae381 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:18 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1efb4413-027c-40e2-93d5-676e050ae381 Jun 04 13:25:18 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:18 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1efb4413-027c-40e2-93d5-676e050ae381" returned: 0 in 0.681s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-1efb4413-027c-40e2-93d5-676e050ae381" released by "delete_volume" :: held 1.573s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Created reservations ['a30a4383-96af-4187-a389-9bf1375dfa3e', 'e9e2b628-b845-475c-93d8-943237d77525', 'a691771b-9127-4e80-aa02-9b52eedff109', '74ec9ec7-9b10-499e-90a5-049d61091fb2'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:19 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:25:19 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-bd8e42d6-5a43-473a-a40a-27593c777801-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Lock "cinder-bd8e42d6-5a43-473a-a40a-27593c777801-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Acquiring lock "cinder-quobyte-bd8e42d6-5a43-473a-a40a-27593c777801" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-bd8e42d6-5a43-473a-a40a-27593c777801" acquired by "delete_volume" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf77d211-471e-42f5-af92-ab24cc9ace55]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:19 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.787s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:25:19 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 Jun 04 13:25:19 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:19 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Deleted volume successfully. Jun 04 13:25:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a99daa91-2411-4769-805a-9b56c99e3b8d tempest-VolumesGetTest-1940282496 None] Lock "cinder-1efb4413-027c-40e2-93d5-676e050ae381-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:20 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801" returned: 0 in 1.108s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:21 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 Jun 04 13:25:21 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:21 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801" returned: 1 in 0.787s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:25:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:21 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801 Jun 04 13:25:21 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:22 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bd8e42d6-5a43-473a-a40a-27593c777801" returned: 0 in 0.743s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Lock "cinder-quobyte-bd8e42d6-5a43-473a-a40a-27593c777801" released by "delete_volume" :: held 2.726s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:22 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Created reservations ['2be1a4b7-fef2-49b0-90ec-51ab30296a41', 'eed8db44-3c7f-49a5-af56-165c2e432d3e', 'a24765b0-fb9b-494a-9eb2-37c00bc28544', '3079f900-a444-4a16-8d46-5c81f666b803'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:25:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:22 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:25:22 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:23 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.847s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:23 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:25:23 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Deleted volume successfully. Jun 04 13:25:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a7086f9c-1112-4311-887a-cc1b48fe0a13 tempest-VolumesGetTest-1940282496 None] Lock "cinder-bd8e42d6-5a43-473a-a40a-27593c777801-delete_volume" released by "delete_volume" :: held 3.862s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Flow 'volume_create_manager' (f547e0c0-ff51-455a-b858-fb19f0d84b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a14fa0-eb58-4b81-9839-caa626662abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a14fa0-eb58-4b81-9839-caa626662abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-117412741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaeb2cf8-b48e-4e47-9e92-2402519a4912,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2cc5cfd015b4ce7b45c5815b2c07f19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:27Z,use_quota=True,user_id='ceb9e3f1e88f48f395e76edf79a7dd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964861e7-67af-4c6e-a72b-2062eafab63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964861e7-67af-4c6e-a72b-2062eafab63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b4e112-830c-4c1c-96f6-06d892aba46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b4e112-830c-4c1c-96f6-06d892aba46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaeb2cf8-b48e-4e47-9e92-2402519a4912', 'volume_name': 'volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82dd0d7f-fc51-4a9e-a324-1887e1d47001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82dd0d7f-fc51-4a9e-a324-1887e1d47001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51262660-ca2b-4648-be44-a0c614c5428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:27 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Volume aaeb2cf8-b48e-4e47-9e92-2402519a4912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912', 'volume_size': 1} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-117412741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaeb2cf8-b48e-4e47-9e92-2402519a4912,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2cc5cfd015b4ce7b45c5815b2c07f19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:27Z,use_quota=True,user_id='ceb9e3f1e88f48f395e76edf79a7dd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Creating volume aaeb2cf8-b48e-4e47-9e92-2402519a4912 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:25:27 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:25:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:27 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912 1073741824 Jun 04 13:25:27 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:28 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912 1073741824" returned: 0 in 1.117s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:28 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912 Jun 04 13:25:28 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:29 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912" returned: 0 in 0.816s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:25:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51262660-ca2b-4648-be44-a0c614c5428a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df03ad9-dd0d-401f-b955-c704fe1bbe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:29 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Volume volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912 (aaeb2cf8-b48e-4e47-9e92-2402519a4912): created successfully Jun 04 13:25:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4df03ad9-dd0d-401f-b955-c704fe1bbe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Flow 'volume_create_manager' (f547e0c0-ff51-455a-b858-fb19f0d84b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:29 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-bc227590-c605-406d-b1c3-b6b628269496 tempest-VolumesListTestJSON-1625372009 None] Created volume successfully. Jun 04 13:25:30 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:25:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Flow 'volume_create_manager' (9e2f8009-8d9e-44ba-8722-6964d621b6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c024e5a-b07e-4767-b900-2e057a515d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c024e5a-b07e-4767-b900-2e057a515d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2074605095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=defffb05-2f76-4529-bffe-c17657671bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d724f4eda946dc87321c3bf89d3270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:31Z,use_quota=True,user_id='5c2079c65c644b3baad65878763f3b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d8dc36-60e5-4f45-8e5d-252ed470e746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d8dc36-60e5-4f45-8e5d-252ed470e746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04180c8-a5f2-4772-949f-d8a9dcdad7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04180c8-a5f2-4772-949f-d8a9dcdad7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'defffb05-2f76-4529-bffe-c17657671bdf', 'volume_name': 'volume-defffb05-2f76-4529-bffe-c17657671bdf', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92729b0f-1548-4837-9a00-a1fb084cba70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92729b0f-1548-4837-9a00-a1fb084cba70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776fe951-daf4-4d05-9b17-f90a9605d5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:31 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Volume defffb05-2f76-4529-bffe-c17657671bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-defffb05-2f76-4529-bffe-c17657671bdf', 'volume_size': 1} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2074605095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=defffb05-2f76-4529-bffe-c17657671bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d724f4eda946dc87321c3bf89d3270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:31Z,use_quota=True,user_id='5c2079c65c644b3baad65878763f3b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Creating volume defffb05-2f76-4529-bffe-c17657671bdf {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:25:31 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-defffb05-2f76-4529-bffe-c17657671bdf 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:31 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-defffb05-2f76-4529-bffe-c17657671bdf 1073741824 Jun 04 13:25:31 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Flow 'volume_create_manager' (fb9709f2-a96d-43e0-a5ae-d410b8912795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4397c69e-3ba1-47ea-a1d3-762e952a8d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4397c69e-3ba1-47ea-a1d3-762e952a8d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-420752767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a5b6e1c-ea91-4118-b71a-fb729709ac19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2cc5cfd015b4ce7b45c5815b2c07f19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:31Z,use_quota=True,user_id='ceb9e3f1e88f48f395e76edf79a7dd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab55c19c-af76-4356-ad69-21e6a288edf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab55c19c-af76-4356-ad69-21e6a288edf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839f7dea-18e8-4ef7-ac0b-56db455b8431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839f7dea-18e8-4ef7-ac0b-56db455b8431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a5b6e1c-ea91-4118-b71a-fb729709ac19', 'volume_name': 'volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6230a34c-be53-409b-96a2-52e210da30c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6230a34c-be53-409b-96a2-52e210da30c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70edc22-7cce-4f0b-94b6-e1af11bd2209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:31 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Volume 9a5b6e1c-ea91-4118-b71a-fb729709ac19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19', 'volume_size': 1} Jun 04 13:25:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:32 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-defffb05-2f76-4529-bffe-c17657671bdf 1073741824" returned: 0 in 1.194s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-defffb05-2f76-4529-bffe-c17657671bdf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:32 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-defffb05-2f76-4529-bffe-c17657671bdf Jun 04 13:25:32 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:33 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-defffb05-2f76-4529-bffe-c17657671bdf" returned: 0 in 0.961s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] <== create_volume: return (2230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.232s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.115s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-420752767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a5b6e1c-ea91-4118-b71a-fb729709ac19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2cc5cfd015b4ce7b45c5815b2c07f19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:31Z,use_quota=True,user_id='ceb9e3f1e88f48f395e76edf79a7dd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Creating volume 9a5b6e1c-ea91-4118-b71a-fb729709ac19 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:25:33 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776fe951-daf4-4d05-9b17-f90a9605d5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-defffb05-2f76-4529-bffe-c17657671bdf', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6363b423-3889-43f2-a7a6-3c7f57be3ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:33 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19 1073741824 Jun 04 13:25:33 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:33 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Volume volume-defffb05-2f76-4529-bffe-c17657671bdf (defffb05-2f76-4529-bffe-c17657671bdf): created successfully Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6363b423-3889-43f2-a7a6-3c7f57be3ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Flow 'volume_create_manager' (9e2f8009-8d9e-44ba-8722-6964d621b6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:33 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f5d2d3cb-d2b1-4c69-b58c-942999f08c03 tempest-VolumesListAdminTestJSON-1353510634 None] Created volume successfully. Jun 04 13:25:34 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19 1073741824" returned: 0 in 0.944s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:34 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19 Jun 04 13:25:34 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Flow 'volume_create_manager' (40917fcf-8751-437b-81af-4f68372a828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48420eb-9c2d-4880-92c2-31720ceb0107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48420eb-9c2d-4880-92c2-31720ceb0107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-497268722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23aea089-f72d-4b61-ac48-49358ccc827a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d724f4eda946dc87321c3bf89d3270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:35Z,use_quota=True,user_id='5c2079c65c644b3baad65878763f3b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfd8e53-2680-4a4e-b01c-f9efcf8d87a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbfd8e53-2680-4a4e-b01c-f9efcf8d87a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70106737-9c95-4650-8842-98f41dd9c1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70106737-9c95-4650-8842-98f41dd9c1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23aea089-f72d-4b61-ac48-49358ccc827a', 'volume_name': 'volume-23aea089-f72d-4b61-ac48-49358ccc827a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f776f4-9400-4d78-878e-99f3df4ea5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f776f4-9400-4d78-878e-99f3df4ea5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bd3d60-0b99-404d-b82a-7c0ca4086d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:34 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Volume 23aea089-f72d-4b61-ac48-49358ccc827a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23aea089-f72d-4b61-ac48-49358ccc827a', 'volume_size': 1} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:35 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-acbb5dee-b3cc-4e04-b1ce-9afed7d90019 tempest-VolumesActionsTest-622811305 None] Acquiring lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c" by "attach_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19" returned: 0 in 1.010s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-497268722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23aea089-f72d-4b61-ac48-49358ccc827a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d724f4eda946dc87321c3bf89d3270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:35Z,use_quota=True,user_id='5c2079c65c644b3baad65878763f3b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Creating volume 23aea089-f72d-4b61-ac48-49358ccc827a {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:25:35 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23aea089-f72d-4b61-ac48-49358ccc827a 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:35 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23aea089-f72d-4b61-ac48-49358ccc827a 1073741824 Jun 04 13:25:35 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-acbb5dee-b3cc-4e04-b1ce-9afed7d90019 tempest-VolumesActionsTest-622811305 None] Lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c" acquired by "attach_volume" :: waited 0.080s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70edc22-7cce-4f0b-94b6-e1af11bd2209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76db3036-fa1c-4949-8318-4598ce2d71b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:35 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Volume volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19 (9a5b6e1c-ea91-4118-b71a-fb729709ac19): created successfully Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76db3036-fa1c-4949-8318-4598ce2d71b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Flow 'volume_create_manager' (fb9709f2-a96d-43e0-a5ae-d410b8912795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:35 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-51be5665-f1a8-46f5-872b-bd82b19f7d3c tempest-VolumesListTestJSON-1625372009 None] Created volume successfully. Jun 04 13:25:35 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-acbb5dee-b3cc-4e04-b1ce-9afed7d90019 tempest-VolumesActionsTest-622811305 None] Attaching volume a39503f6-1033-47a7-a895-94d94aacb97c to instance 9be8ba70-6f23-405c-b0d0-13e83363d9d4 at mountpoint /dev/vdb on host None. Jun 04 13:25:35 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-acbb5dee-b3cc-4e04-b1ce-9afed7d90019 tempest-VolumesActionsTest-622811305 None] Attach volume completed successfully. Jun 04 13:25:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-acbb5dee-b3cc-4e04-b1ce-9afed7d90019 tempest-VolumesActionsTest-622811305 None] Lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c" released by "attach_volume" :: held 0.151s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-480522ba-a3dd-4fae-bb96-74cdd9ce51d8 tempest-VolumesActionsTest-622811305 None] Acquiring lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c-detach_volume" by "detach_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-480522ba-a3dd-4fae-bb96-74cdd9ce51d8 tempest-VolumesActionsTest-622811305 None] Lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:36 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-480522ba-a3dd-4fae-bb96-74cdd9ce51d8 tempest-VolumesActionsTest-622811305 None] Detaching volume a39503f6-1033-47a7-a895-94d94aacb97c from instance 9be8ba70-6f23-405c-b0d0-13e83363d9d4. Jun 04 13:25:36 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-480522ba-a3dd-4fae-bb96-74cdd9ce51d8 tempest-VolumesActionsTest-622811305 None] Detach volume completed successfully. Jun 04 13:25:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-480522ba-a3dd-4fae-bb96-74cdd9ce51d8 tempest-VolumesActionsTest-622811305 None] Lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:36 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23aea089-f72d-4b61-ac48-49358ccc827a 1073741824" returned: 0 in 1.190s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23aea089-f72d-4b61-ac48-49358ccc827a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:36 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23aea089-f72d-4b61-ac48-49358ccc827a Jun 04 13:25:36 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Flow 'volume_create_manager' (f095af63-df5b-4f00-9f84-b77e7c3f629e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc4a22e-509d-42cc-844d-d0885d4827a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecc4a22e-509d-42cc-844d-d0885d4827a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-774766471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2cc5cfd015b4ce7b45c5815b2c07f19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:37Z,use_quota=True,user_id='ceb9e3f1e88f48f395e76edf79a7dd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10425b3b-3a62-4417-bfa0-394d88545906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10425b3b-3a62-4417-bfa0-394d88545906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2424f96-7d33-4f83-9880-dc092a2aff05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2424f96-7d33-4f83-9880-dc092a2aff05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19', 'volume_name': 'volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8432d655-a8c0-4cc9-b1d4-421786fbe8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8432d655-a8c0-4cc9-b1d4-421786fbe8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3343ac-c626-4d11-92f5-73350d03d6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:37 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Volume 23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19', 'volume_size': 1} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:37 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23aea089-f72d-4b61-ac48-49358ccc827a" returned: 0 in 0.986s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] <== create_volume: return (2241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.246s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.381s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-774766471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f2cc5cfd015b4ce7b45c5815b2c07f19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:37Z,use_quota=True,user_id='ceb9e3f1e88f48f395e76edf79a7dd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Creating volume 23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:25:37 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bd3d60-0b99-404d-b82a-7c0ca4086d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23aea089-f72d-4b61-ac48-49358ccc827a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a50b4e-8238-4154-b2bf-a45f7a76b823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:37 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Volume volume-23aea089-f72d-4b61-ac48-49358ccc827a (23aea089-f72d-4b61-ac48-49358ccc827a): created successfully Jun 04 13:25:37 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19 1073741824 Jun 04 13:25:37 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6a50b4e-8238-4154-b2bf-a45f7a76b823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Flow 'volume_create_manager' (40917fcf-8751-437b-81af-4f68372a828a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:37 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f75f2bb5-c6bd-4527-b6fc-bde4cf1c07d8 tempest-VolumesListAdminTestJSON-1353510634 None] Created volume successfully. Jun 04 13:25:39 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19 1073741824" returned: 0 in 1.556s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Flow 'volume_create_manager' (ab54126d-1ce4-49c7-8546-1496af34bae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd9f505-073c-463d-a21b-47ae2d9f8f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd9f505-073c-463d-a21b-47ae2d9f8f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-769807024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c006302-7a17-408a-870c-0f6a006960b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d724f4eda946dc87321c3bf89d3270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:39Z,use_quota=True,user_id='5c2079c65c644b3baad65878763f3b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:39 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19 Jun 04 13:25:39 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e0e6a91-7b7a-4972-95b5-531e6c75edf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e0e6a91-7b7a-4972-95b5-531e6c75edf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69ef367-236a-4335-846d-cf2f05d779ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b69ef367-236a-4335-846d-cf2f05d779ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c006302-7a17-408a-870c-0f6a006960b4', 'volume_name': 'volume-5c006302-7a17-408a-870c-0f6a006960b4', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f46f9e-40cd-4003-a60e-201da4f82a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f46f9e-40cd-4003-a60e-201da4f82a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3babe100-2593-446c-877c-47138ea4d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:39 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Volume 5c006302-7a17-408a-870c-0f6a006960b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c006302-7a17-408a-870c-0f6a006960b4', 'volume_size': 1} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:39 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19" returned: 0 in 0.734s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] <== create_volume: return (2429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.433s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.641s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-769807024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c006302-7a17-408a-870c-0f6a006960b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d724f4eda946dc87321c3bf89d3270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:39Z,use_quota=True,user_id='5c2079c65c644b3baad65878763f3b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Creating volume 5c006302-7a17-408a-870c-0f6a006960b4 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:25:40 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:25:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5c006302-7a17-408a-870c-0f6a006960b4 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:40 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5c006302-7a17-408a-870c-0f6a006960b4 1073741824 Jun 04 13:25:40 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3343ac-c626-4d11-92f5-73350d03d6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b5452e-389e-4dab-90ef-0f660097b20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:40 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Volume volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19 (23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19): created successfully Jun 04 13:25:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b5452e-389e-4dab-90ef-0f660097b20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Flow 'volume_create_manager' (f095af63-df5b-4f00-9f84-b77e7c3f629e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:40 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c9ab3d24-270d-42d4-98ea-630f8233975c tempest-VolumesListTestJSON-1625372009 None] Created volume successfully. Jun 04 13:25:40 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5c006302-7a17-408a-870c-0f6a006960b4 1073741824" returned: 0 in 0.984s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5c006302-7a17-408a-870c-0f6a006960b4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:41 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5c006302-7a17-408a-870c-0f6a006960b4 Jun 04 13:25:41 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:41 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5c006302-7a17-408a-870c-0f6a006960b4" returned: 0 in 0.673s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:25:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3babe100-2593-446c-877c-47138ea4d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c006302-7a17-408a-870c-0f6a006960b4', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c726a0-bf12-48b3-91ba-20e3136d44a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:41 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Volume volume-5c006302-7a17-408a-870c-0f6a006960b4 (5c006302-7a17-408a-870c-0f6a006960b4): created successfully Jun 04 13:25:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22c726a0-bf12-48b3-91ba-20e3136d44a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Flow 'volume_create_manager' (ab54126d-1ce4-49c7-8546-1496af34bae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:41 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c2caeb5c-2285-4b33-b539-19c655ad422c tempest-VolumesListAdminTestJSON-1353510634 None] Created volume successfully. Jun 04 13:25:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "cinder-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Lock "cinder-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "cinder-quobyte-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Lock "cinder-quobyte-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19" acquired by "delete_volume" :: waited 0.036s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:42 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94f24e2-8f3f-435d-b736-a8bdc3def529]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Flow 'volume_create_manager' (72c256f2-fbb5-4f55-a1d9-943124eae062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56eb9a0c-06bc-4afe-aeb1-c4fed8895b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56eb9a0c-06bc-4afe-aeb1-c4fed8895b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a2049c-d734-4eab-852f-109e1b91ea76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfe1308f7b94780a9751946729a572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:43Z,use_quota=True,user_id='26851a37b2334cacada12e55ff891844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98304f68-6f26-4583-90ef-4e37cd9fcba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:43 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19 Jun 04 13:25:43 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98304f68-6f26-4583-90ef-4e37cd9fcba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1ce2b3-18be-4b9c-9348-6454a38f06ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1ce2b3-18be-4b9c-9348-6454a38f06ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a2049c-d734-4eab-852f-109e1b91ea76', 'volume_name': 'volume-e1a2049c-d734-4eab-852f-109e1b91ea76', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf2bae8-727d-4024-9c04-7a5ce19b763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf2bae8-727d-4024-9c04-7a5ce19b763b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91676df-be92-4684-a5f2-573bfe3d9c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:43 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Volume e1a2049c-d734-4eab-852f-109e1b91ea76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a2049c-d734-4eab-852f-109e1b91ea76', 'volume_size': 1} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a2049c-d734-4eab-852f-109e1b91ea76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccfe1308f7b94780a9751946729a572f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:25:43Z,use_quota=True,user_id='26851a37b2334cacada12e55ff891844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Creating volume e1a2049c-d734-4eab-852f-109e1b91ea76 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:25:43 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e1a2049c-d734-4eab-852f-109e1b91ea76 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:43 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e1a2049c-d734-4eab-852f-109e1b91ea76 1073741824 Jun 04 13:25:43 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:43 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19" returned: 0 in 0.861s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:43 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19 Jun 04 13:25:43 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:44 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e1a2049c-d734-4eab-852f-109e1b91ea76 1073741824" returned: 0 in 0.906s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e1a2049c-d734-4eab-852f-109e1b91ea76 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:44 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e1a2049c-d734-4eab-852f-109e1b91ea76 Jun 04 13:25:44 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:44 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19" returned: 0 in 0.651s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Lock "cinder-quobyte-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19" released by "delete_volume" :: held 1.570s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Created reservations ['da23938f-3c65-40ab-9ae0-677717e04e24', '35fd0313-5421-41f9-b5d3-0d83b1bd33c3', '5b65f305-cce0-4df7-825f-5773de2e2c5b', '9524970e-6bd8-47cc-b085-8628cd8f4b66'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:44 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:25:44 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:44 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e1a2049c-d734-4eab-852f-109e1b91ea76" returned: 0 in 0.729s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91676df-be92-4684-a5f2-573bfe3d9c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a2049c-d734-4eab-852f-109e1b91ea76', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4349d925-989b-4776-ada7-73c3bef08ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:25:44 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Volume volume-e1a2049c-d734-4eab-852f-109e1b91ea76 (e1a2049c-d734-4eab-852f-109e1b91ea76): created successfully Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4349d925-989b-4776-ada7-73c3bef08ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:25:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Flow 'volume_create_manager' (72c256f2-fbb5-4f55-a1d9-943124eae062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:25:44 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9a5a9d6a-8f0f-43c6-8ca2-f9b0b587565a tempest-VolumesListAdminTestJSON-1196160412 None] Created volume successfully. Jun 04 13:25:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "cinder-9a5b6e1c-ea91-4118-b71a-fb729709ac19-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Lock "cinder-9a5b6e1c-ea91-4118-b71a-fb729709ac19-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "cinder-quobyte-9a5b6e1c-ea91-4118-b71a-fb729709ac19" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Lock "cinder-quobyte-9a5b6e1c-ea91-4118-b71a-fb729709ac19" acquired by "delete_volume" :: waited 0.032s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Acquiring lock "cinder-e1a2049c-d734-4eab-852f-109e1b91ea76-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:45 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac1cdbc-76f0-4f4f-bbd5-debce042432b]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Lock "cinder-e1a2049c-d734-4eab-852f-109e1b91ea76-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:45 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.297s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:45 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:25:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Acquiring lock "cinder-quobyte-e1a2049c-d734-4eab-852f-109e1b91ea76" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Deleted volume successfully. Jun 04 13:25:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Lock "cinder-quobyte-e1a2049c-d734-4eab-852f-109e1b91ea76" acquired by "delete_volume" :: waited 0.092s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d672dd05-b96b-4b8a-82b7-26c788defb5b tempest-VolumesListTestJSON-1625372009 None] Lock "cinder-23cfcb99-a1f2-4b3d-9cc1-1aa80b7dcd19-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:46 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19 Jun 04 13:25:46 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[24759987-a4be-4848-a4da-324c7408f6b0]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e1a2049c-d734-4eab-852f-109e1b91ea76 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "cinder-5c006302-7a17-408a-870c-0f6a006960b4-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "cinder-5c006302-7a17-408a-870c-0f6a006960b4-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:46 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e1a2049c-d734-4eab-852f-109e1b91ea76 Jun 04 13:25:46 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "cinder-quobyte-5c006302-7a17-408a-870c-0f6a006960b4" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "cinder-quobyte-5c006302-7a17-408a-870c-0f6a006960b4" acquired by "delete_volume" :: waited 0.044s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[45544f24-e8ef-4f75-86fb-55aefdeab327]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5c006302-7a17-408a-870c-0f6a006960b4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:46 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5c006302-7a17-408a-870c-0f6a006960b4 Jun 04 13:25:46 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:47 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:47 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5c006302-7a17-408a-870c-0f6a006960b4" returned: 0 in 1.250s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5c006302-7a17-408a-870c-0f6a006960b4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e1a2049c-d734-4eab-852f-109e1b91ea76" returned: 0 in 1.687s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e1a2049c-d734-4eab-852f-109e1b91ea76 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:47 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5c006302-7a17-408a-870c-0f6a006960b4 Jun 04 13:25:47 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:47 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e1a2049c-d734-4eab-852f-109e1b91ea76 Jun 04 13:25:47 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:47 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19" returned: 0 in 2.147s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:48 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19 Jun 04 13:25:48 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:48 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a7f8ef-9cdf-470a-b998-714f303ebf0e]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:48 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c Jun 04 13:25:48 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:49 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e1a2049c-d734-4eab-852f-109e1b91ea76" returned: 0 in 1.261s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Lock "cinder-quobyte-e1a2049c-d734-4eab-852f-109e1b91ea76" released by "delete_volume" :: held 3.067s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Created reservations ['d9f35f9f-b5cc-4624-93c3-fc1e4337b692', '6cc88e59-11f9-477b-8ae3-c3163182ad18', 'e6d9b729-b8a3-49a6-a880-1adba81c37e0', 'a415ae2e-f6f2-4709-8d4a-a268f9b4c83b'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:25:49 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5c006302-7a17-408a-870c-0f6a006960b4" returned: 0 in 1.484s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "cinder-quobyte-5c006302-7a17-408a-870c-0f6a006960b4" released by "delete_volume" :: held 2.892s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Created reservations ['14377d68-67a9-4de5-becc-bb82224c69d3', '71a3e3c1-0e6d-4299-b3f3-1408e16432ea', '71e4fb4f-336f-4bf3-a27a-3acd666fb638', '1d9f8631-6118-45e6-bb4d-3e91a66fffc8'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:25:49 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:25:49 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:49 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9a5b6e1c-ea91-4118-b71a-fb729709ac19" returned: 0 in 1.763s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Lock "cinder-quobyte-9a5b6e1c-ea91-4118-b71a-fb729709ac19" released by "delete_volume" :: held 4.039s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:49 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Created reservations ['0012615c-27af-44d6-ba22-1fc79004cebd', '3797577c-90bb-4a91-aae4-d02887e56155', '6b0e8947-fb03-4195-bed1-bfc148258e5a', '9b57bd71-5ffe-480d-a3c3-140244d11160'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:25:49 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:25:49 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:50 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:25:50 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:50 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "cinder-23aea089-f72d-4b61-ac48-49358ccc827a-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c" returned: 0 in 1.526s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "cinder-23aea089-f72d-4b61-ac48-49358ccc827a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54f8125-3930-444a-b1b3-10801dfe33fc]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "cinder-quobyte-23aea089-f72d-4b61-ac48-49358ccc827a" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "cinder-quobyte-23aea089-f72d-4b61-ac48-49358ccc827a" acquired by "delete_volume" :: waited 0.053s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fbb7b4-869e-4e45-8cd0-1b387740f253]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23aea089-f72d-4b61-ac48-49358ccc827a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:50 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c Jun 04 13:25:50 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "cinder-aaeb2cf8-b48e-4e47-9e92-2402519a4912-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Lock "cinder-aaeb2cf8-b48e-4e47-9e92-2402519a4912-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:50 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23aea089-f72d-4b61-ac48-49358ccc827a Jun 04 13:25:50 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "cinder-quobyte-aaeb2cf8-b48e-4e47-9e92-2402519a4912" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Lock "cinder-quobyte-aaeb2cf8-b48e-4e47-9e92-2402519a4912" acquired by "delete_volume" :: waited 0.059s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d774727-a88f-4fe7-a44b-93906255ff2f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:51 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.718s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:25:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Deleted volume successfully. Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-736fc5eb-7fc2-400c-8216-c1f3f992b19d tempest-VolumesListAdminTestJSON-1196160412 None] Lock "cinder-e1a2049c-d734-4eab-852f-109e1b91ea76-delete_volume" released by "delete_volume" :: held 5.496s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:51 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:51 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912 Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.606s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:51 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:25:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Deleted volume successfully. Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-451f4fc4-6470-4c1a-9e59-050c3acd16f4 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "cinder-5c006302-7a17-408a-870c-0f6a006960b4-delete_volume" released by "delete_volume" :: held 5.293s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:51 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.700s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:25:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Deleted volume successfully. Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=146,cinder:DELETE=17,cinder:SELECT=106,cinder:INSERT=48 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:25:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ff14898f-4daa-4f41-b2ba-2d46a02a6d1e tempest-VolumesListTestJSON-1625372009 None] Lock "cinder-9a5b6e1c-ea91-4118-b71a-fb729709ac19-delete_volume" released by "delete_volume" :: held 6.297s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:52 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c" returned: 0 in 2.099s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.b410704c-c57f-4c66-a524-49d86a28689cjv2gtcq_.img {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:52 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.b410704c-c57f-4c66-a524-49d86a28689cjv2gtcq_.img Jun 04 13:25:52 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:52 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23aea089-f72d-4b61-ac48-49358ccc827a" returned: 0 in 1.874s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23aea089-f72d-4b61-ac48-49358ccc827a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:52 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23aea089-f72d-4b61-ac48-49358ccc827a Jun 04 13:25:52 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:52 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912" returned: 0 in 1.486s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:52 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912 Jun 04 13:25:52 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:53 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-23aea089-f72d-4b61-ac48-49358ccc827a" returned: 0 in 1.461s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "cinder-quobyte-23aea089-f72d-4b61-ac48-49358ccc827a" released by "delete_volume" :: held 3.434s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=119,cinder:INSERT=33,cinder:UPDATE=151,cinder:DELETE=9 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Created reservations ['6566c617-4dcc-468e-90f6-257b1320caca', 'ca27c042-62cd-4b4c-88d7-0d7918dab329', 'a4e25758-0608-4551-b346-754ad764d624', '9d6d93ad-e3fe-4f75-bf21-ef1c968b3b4c'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:54 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-aaeb2cf8-b48e-4e47-9e92-2402519a4912" returned: 0 in 1.861s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Lock "cinder-quobyte-aaeb2cf8-b48e-4e47-9e92-2402519a4912" released by "delete_volume" :: held 3.437s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:54 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:25:54 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Created reservations ['9f43348d-f434-4ffc-9a61-9dfab5bdd525', 'f0d6da2b-016d-4f14-811c-1d56d8c506ba', '0dd0fa49-8605-403b-8cf7-ddc15de92343', 'a8a4ce54-023f-4a7c-b5ed-d04ecd200033'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:25:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:55 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:25:55 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "cinder-defffb05-2f76-4529-bffe-c17657671bdf-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "cinder-defffb05-2f76-4529-bffe-c17657671bdf-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "cinder-quobyte-defffb05-2f76-4529-bffe-c17657671bdf" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:25:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "cinder-quobyte-defffb05-2f76-4529-bffe-c17657671bdf" acquired by "delete_volume" :: waited 0.072s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:25:55 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aca538c-0467-4b90-b369-6d35a6a7db60]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-defffb05-2f76-4529-bffe-c17657671bdf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:56 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-defffb05-2f76-4529-bffe-c17657671bdf Jun 04 13:25:56 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:56 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 2.197s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:56 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:25:56 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Deleted volume successfully. Jun 04 13:25:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f8434aa6-6297-42e7-b019-b3452d4715a1 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "cinder-23aea089-f72d-4b61-ac48-49358ccc827a-delete_volume" released by "delete_volume" :: held 6.607s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:57 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 2.279s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:57 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:25:57 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Deleted volume successfully. Jun 04 13:25:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d0645300-5f1b-4c36-b6d9-7f75007908c2 tempest-VolumesListTestJSON-1625372009 None] Lock "cinder-aaeb2cf8-b48e-4e47-9e92-2402519a4912-delete_volume" released by "delete_volume" :: held 6.363s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:25:58 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-defffb05-2f76-4529-bffe-c17657671bdf" returned: 0 in 2.928s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-defffb05-2f76-4529-bffe-c17657671bdf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:58 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-defffb05-2f76-4529-bffe-c17657671bdf Jun 04 13:25:59 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:25:59 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jun 04 13:25:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.b410704c-c57f-4c66-a524-49d86a28689cjv2gtcq_.img" returned: 0 in 7.256s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:25:59 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fad01d-7bab-4631-b162-526de6a52694]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:25:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:25:59 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c Jun 04 13:25:59 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:00 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-defffb05-2f76-4529-bffe-c17657671bdf" returned: 0 in 1.203s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "cinder-quobyte-defffb05-2f76-4529-bffe-c17657671bdf" released by "delete_volume" :: held 4.254s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:00 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Created reservations ['cefd0d35-9f34-456b-abd5-e1692a990b18', 'c202612a-430e-4895-8004-559861733e7a', '044f6d8c-8707-4217-9523-20b843916511', 'b0e3e391-75f3-45d0-a5fe-2789b5fe84c7'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:26:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:00 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:26:00 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:00 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c" returned: 0 in 1.166s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:00 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c, size 1024.00 MB, duration 7.26 sec, destination /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.b410704c-c57f-4c66-a524-49d86a28689cjv2gtcq_.img {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:26:00 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] Converted 1024.00 MB image at 141.10 MB/s Jun 04 13:26:00 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] b410704c-c57f-4c66-a524-49d86a28689c was raw, no need to convert to raw {{(pid=86722) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 04 13:26:01 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.849s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:01 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:26:01 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Deleted volume successfully. Jun 04 13:26:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8c3086bf-cba3-4ed9-9098-d7f043fded05 tempest-VolumesListAdminTestJSON-1353510634 None] Lock "cinder-defffb05-2f76-4529-bffe-c17657671bdf-delete_volume" released by "delete_volume" :: held 5.532s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:02 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:26:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Flow 'volume_create_manager' (6a490bf4-ad71-4358-a947-6be45f7081c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:26:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce885d96-1751-4568-98cd-e3b169dad64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce885d96-1751-4568-98cd-e3b169dad64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1882352762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5597e3-b918-40a9-9777-42453ba07d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c2ce7d8f814994a993dcadc96cdbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:26:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:26:02Z,use_quota=True,user_id='51f2aa59c6374c519279d86c16ccdcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04dfce0-c423-408e-b794-a406b66dcfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04dfce0-c423-408e-b794-a406b66dcfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f84112-eda4-4383-b7ff-035fd03cb734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f84112-eda4-4383-b7ff-035fd03cb734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b5597e3-b918-40a9-9777-42453ba07d5d', 'volume_name': 'volume-5b5597e3-b918-40a9-9777-42453ba07d5d', 'volume_size': 2}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66ec7e0-4075-4c40-b3e0-c26cff8f638f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66ec7e0-4075-4c40-b3e0-c26cff8f638f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3caff6d3-200f-40e4-b6d3-795823289436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:02 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Volume 5b5597e3-b918-40a9-9777-42453ba07d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b5597e3-b918-40a9-9777-42453ba07d5d', 'volume_size': 2} Jun 04 13:26:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:26:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:04 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:26:04 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:04 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.744s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:26:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:26:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:26:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:26:09 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:26:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Flow 'volume_create_manager' (0ceaa8f1-ba6f-4427-8fd0-fde20aaf8b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:26:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89c453b-fb38-49de-b4b3-c28ec75a1c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89c453b-fb38-49de-b4b3-c28ec75a1c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-826309649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a8ed32-44ca-480c-ad22-23017dacea7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='642dfe62cc1143ae995bfe4c16b7add6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:26:10Z,use_quota=True,user_id='7e64f6a47ff148d3a18bbd96fe48d528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffb0e6f-e04f-424f-8ba6-8e381fc72dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffb0e6f-e04f-424f-8ba6-8e381fc72dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc0c8ea-aeb8-49ae-b906-9f14f16f6b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc0c8ea-aeb8-49ae-b906-9f14f16f6b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a8ed32-44ca-480c-ad22-23017dacea7a', 'volume_name': 'volume-b9a8ed32-44ca-480c-ad22-23017dacea7a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c74f462-a5ce-4081-b061-ad072a20e04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c74f462-a5ce-4081-b061-ad072a20e04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba330e9-44f9-4cf0-9f42-86433b681312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:09 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Volume b9a8ed32-44ca-480c-ad22-23017dacea7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a8ed32-44ca-480c-ad22-23017dacea7a', 'volume_size': 1} Jun 04 13:26:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=22,cinder:SELECT=13,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Flow 'volume_create_manager' (67848990-83da-4b33-a9bd-c6e5942f5fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0ad2ef-058b-4a64-a8d5-7c78e4f8a7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db0ad2ef-058b-4a64-a8d5-7c78e4f8a7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-101418269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f19220-7d00-406b-bf08-b06c42ebb397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a41550f3ed244e6a00b49a1e55c884b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:26:12Z,use_quota=True,user_id='34bd751d332c4f66ba1a17b999d7db3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968e2e6b-c580-4db6-8769-19463fe653b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968e2e6b-c580-4db6-8769-19463fe653b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b0ba53-7400-4d28-8f72-0b2e9d3866df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b0ba53-7400-4d28-8f72-0b2e9d3866df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2f19220-7d00-406b-bf08-b06c42ebb397', 'volume_name': 'volume-c2f19220-7d00-406b-bf08-b06c42ebb397', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5ee24d-9454-42be-a9f2-19adb6d20ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5ee24d-9454-42be-a9f2-19adb6d20ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6854af-23d8-427c-b5f2-6bb49079c3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:12 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Volume c2f19220-7d00-406b-bf08-b06c42ebb397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2f19220-7d00-406b-bf08-b06c42ebb397', 'volume_size': 1} Jun 04 13:26:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.432s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] Uploaded volume to glance image-id: b410704c-c57f-4c66-a524-49d86a28689c. {{(pid=86722) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.479s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1882352762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5597e3-b918-40a9-9777-42453ba07d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c2ce7d8f814994a993dcadc96cdbe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:26:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:26:02Z,use_quota=True,user_id='51f2aa59c6374c519279d86c16ccdcc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Creating volume 5b5597e3-b918-40a9-9777-42453ba07d5d {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:26:21 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d 2147483648 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:21 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d 2147483648 Jun 04 13:26:21 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:21 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-25ba3e53-1d1c-479c-b097-2a93ff01b09f tempest-VolumesActionsTest-622811305 None] Copy volume to image completed successfully. Jun 04 13:26:21 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d 2147483648" returned: 0 in 0.842s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:21 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d Jun 04 13:26:21 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:22 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d" returned: 0 in 0.617s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.643s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-826309649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a8ed32-44ca-480c-ad22-23017dacea7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='642dfe62cc1143ae995bfe4c16b7add6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:26:10Z,use_quota=True,user_id='7e64f6a47ff148d3a18bbd96fe48d528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Creating volume b9a8ed32-44ca-480c-ad22-23017dacea7a {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:26:22 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b9a8ed32-44ca-480c-ad22-23017dacea7a 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:22 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b9a8ed32-44ca-480c-ad22-23017dacea7a 1073741824 Jun 04 13:26:22 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3caff6d3-200f-40e4-b6d3-795823289436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b5597e3-b918-40a9-9777-42453ba07d5d', 'volume_size': 2}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb6e794-a259-4cb3-9367-34daf750eb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:22 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Volume volume-5b5597e3-b918-40a9-9777-42453ba07d5d (5b5597e3-b918-40a9-9777-42453ba07d5d): created successfully Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb6e794-a259-4cb3-9367-34daf750eb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Flow 'volume_create_manager' (6a490bf4-ad71-4358-a947-6be45f7081c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:26:22 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-7ec456c9-5996-42ec-8b2f-2435c878ecbb tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Created volume successfully. Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:23 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b9a8ed32-44ca-480c-ad22-23017dacea7a 1073741824" returned: 0 in 0.778s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b9a8ed32-44ca-480c-ad22-23017dacea7a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:23 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b9a8ed32-44ca-480c-ad22-23017dacea7a Jun 04 13:26:23 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:23 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b9a8ed32-44ca-480c-ad22-23017dacea7a" returned: 0 in 0.617s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.187s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-101418269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f19220-7d00-406b-bf08-b06c42ebb397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a41550f3ed244e6a00b49a1e55c884b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:26:12Z,use_quota=True,user_id='34bd751d332c4f66ba1a17b999d7db3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Creating volume c2f19220-7d00-406b-bf08-b06c42ebb397 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:26:23 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:26:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:24 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397 1073741824 Jun 04 13:26:24 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba330e9-44f9-4cf0-9f42-86433b681312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a8ed32-44ca-480c-ad22-23017dacea7a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f432fc24-6dac-4f8f-a2a8-89292d28ef3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:24 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Volume volume-b9a8ed32-44ca-480c-ad22-23017dacea7a (b9a8ed32-44ca-480c-ad22-23017dacea7a): created successfully Jun 04 13:26:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f432fc24-6dac-4f8f-a2a8-89292d28ef3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Flow 'volume_create_manager' (0ceaa8f1-ba6f-4427-8fd0-fde20aaf8b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:26:24 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9c2d586e-71aa-4d7e-9923-dc0dc4ee9d8a tempest-VolumesTransfersV355Test-326575468 None] Created volume successfully. Jun 04 13:26:24 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397 1073741824" returned: 0 in 0.818s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:24 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397 Jun 04 13:26:24 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:25 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fb7ea7ce-974d-4b54-8d49-62e3e611ebf9 tempest-VolumesTransfersV355Test-167555704 None] Transfer volume completed successfully. Jun 04 13:26:25 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397" returned: 0 in 0.655s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:26:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.353s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6854af-23d8-427c-b5f2-6bb49079c3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2f19220-7d00-406b-bf08-b06c42ebb397', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee8b178-7987-47bb-ad9d-06cd40ee35b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:25 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e464ec8-aa25-4c0a-9217-e179f2ead5e7]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:25 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Volume volume-c2f19220-7d00-406b-bf08-b06c42ebb397 (c2f19220-7d00-406b-bf08-b06c42ebb397): created successfully Jun 04 13:26:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee8b178-7987-47bb-ad9d-06cd40ee35b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Flow 'volume_create_manager' (67848990-83da-4b33-a9bd-c6e5942f5fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:26:25 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e40891b0-7ab8-4216-88d5-c28ce7508991 tempest-AttachVolumeNegativeTest-351245229 None] Created volume successfully. Jun 04 13:26:25 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c Jun 04 13:26:25 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:26 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:26 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Acquiring lock "cinder-b9a8ed32-44ca-480c-ad22-23017dacea7a-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c" returned: 0 in 0.724s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:26 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Lock "cinder-b9a8ed32-44ca-480c-ad22-23017dacea7a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:26 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b399defb-e9ec-4dd9-9b2e-8cc6588fe780]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:26 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Acquiring lock "cinder-quobyte-b9a8ed32-44ca-480c-ad22-23017dacea7a" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:26 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Lock "cinder-quobyte-b9a8ed32-44ca-480c-ad22-23017dacea7a" acquired by "delete_volume" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:26 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[102a9802-3702-46cb-87bd-586a7eaf3a63]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b9a8ed32-44ca-480c-ad22-23017dacea7a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:26 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c Jun 04 13:26:26 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:26 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b9a8ed32-44ca-480c-ad22-23017dacea7a Jun 04 13:26:26 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:27 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c" returned: 0 in 0.780s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:27 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img Jun 04 13:26:27 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:27 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b9a8ed32-44ca-480c-ad22-23017dacea7a" returned: 0 in 0.730s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b9a8ed32-44ca-480c-ad22-23017dacea7a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:27 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b9a8ed32-44ca-480c-ad22-23017dacea7a Jun 04 13:26:27 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:27 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b9a8ed32-44ca-480c-ad22-23017dacea7a" returned: 0 in 0.804s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:27 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Lock "cinder-quobyte-b9a8ed32-44ca-480c-ad22-23017dacea7a" released by "delete_volume" :: held 1.610s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:28 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Created reservations ['c23ae299-5be5-46d9-b02f-baf491f61aa3', '3403fa90-db58-41a4-9452-eb8cca682e3c', 'fbfdb7a8-03c3-485d-83a4-bce42b3c15c6', 'f38996db-79bb-44ca-8b84-a37a3911533a'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:26:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:28 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:26:28 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:28 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.777s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:28 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:26:29 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Deleted volume successfully. Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dad6e5d9-4775-4792-b493-d7b32d58fb4d tempest-VolumesTransfersV355Test-229990852 None] Lock "cinder-b9a8ed32-44ca-480c-ad22-23017dacea7a-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Flow 'volume_create_manager' (1c05c68d-1500-4dd2-859c-9f844c232eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e86314-6d3f-4c86-a561-e9cec835308b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e86314-6d3f-4c86-a561-e9cec835308b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1325769287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b84632-4f1b-4c3b-8911-c5f437a888e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='642dfe62cc1143ae995bfe4c16b7add6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:26:30Z,use_quota=True,user_id='7e64f6a47ff148d3a18bbd96fe48d528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9b1089-53b1-4acd-b62b-7cecd6a98c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9b1089-53b1-4acd-b62b-7cecd6a98c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31760f77-d2ef-4728-99f6-4bf8d9e5682a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31760f77-d2ef-4728-99f6-4bf8d9e5682a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b84632-4f1b-4c3b-8911-c5f437a888e2', 'volume_name': 'volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae66fad-9435-470a-a858-dd0af6db7214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aae66fad-9435-470a-a858-dd0af6db7214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97918475-a68f-43b5-97a7-7234288a080b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:29 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Volume c4b84632-4f1b-4c3b-8911-c5f437a888e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2', 'volume_size': 1} Jun 04 13:26:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-8763ad7d-9dc4-4748-9116-bf4a5980a621 req-41385785-e750-4239-9d50-47bd97e425fb tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:32 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img" returned: 0 in 5.187s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:32 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b62f36-a14c-4c8d-b7e8-587ffda4ba1e]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:32 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c Jun 04 13:26:32 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:33 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c" returned: 0 in 0.879s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:33 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:26:33 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Converted 1024.00 MB image at 197.38 MB/s Jun 04 13:26:33 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d4 was raw, converting to qcow2 {{(pid=86722) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 04 13:26:33 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcead1d1-cdca-4140-b176-4d65986646ee]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:33 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img Jun 04 13:26:33 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:33 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img" returned: 0 in 0.659s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:33 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img Jun 04 13:26:33 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:34 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img" returned: 1 in 0.664s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:26:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img /opt/stack/data/cinder/conversion/vol_upload_2feqqwq6 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:34 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img /opt/stack/data/cinder/conversion/vol_upload_2feqqwq6 Jun 04 13:26:34 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:35 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img /opt/stack/data/cinder/conversion/vol_upload_2feqqwq6" returned: 0 in 0.604s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:35 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Image conversion details: src /opt/stack/data/cinder/conversion/a39503f6-1033-47a7-a895-94d94aacb97c.temp_image.e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d41plt1i3o.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2feqqwq6 {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:26:35 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 04 13:26:35 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b16866-a243-4298-8eec-50262a616fd5]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2feqqwq6 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:35 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2feqqwq6 Jun 04 13:26:35 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:35 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2feqqwq6" returned: 0 in 0.686s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.749s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Uploaded volume to glance image-id: e1f1ea1e-fd1c-4dd1-81f2-2e4ff928a6d4. {{(pid=86722) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Jun 04 13:26:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.238s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Creating offline snapshot adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 of volume 5b5597e3-b918-40a9-9777-42453ba07d5d {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:26:37 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-0192646b-461c-4e99-bcb2-abc860bab42a tempest-VolumesActionsTest-622811305 None] Copy volume to image completed successfully. Jun 04 13:26:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f68ed8-ff15-4569-a239-6b7695828180]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:37 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d Jun 04 13:26:37 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:38 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d" returned: 0 in 0.743s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 2G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:38 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 2G Jun 04 13:26:38 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:38 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Acquiring lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:38 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:38 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Acquiring lock "cinder-quobyte-a39503f6-1033-47a7-a895-94d94aacb97c" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:38 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Lock "cinder-quobyte-a39503f6-1033-47a7-a895-94d94aacb97c" acquired by "delete_volume" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:38 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bbe289-24f9-402c-8cde-2c139d1e4e81]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:38 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c Jun 04 13:26:38 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:38 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 2G" returned: 0 in 0.774s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b5597e3-b918-40a9-9777-42453ba07d5d -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:38 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b5597e3-b918-40a9-9777-42453ba07d5d -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 Jun 04 13:26:38 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:39 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c" returned: 0 in 0.733s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:39 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c Jun 04 13:26:39 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:39 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b5597e3-b918-40a9-9777-42453ba07d5d -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372" returned: 0 in 0.682s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:39 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 is being set with open permissions: ugo+rw Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:39 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 Jun 04 13:26:39 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:39 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a39503f6-1033-47a7-a895-94d94aacb97c" returned: 0 in 0.602s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Lock "cinder-quobyte-a39503f6-1033-47a7-a895-94d94aacb97c" released by "delete_volume" :: held 1.375s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Created reservations ['94ce6e95-4472-465e-8c17-f54042e2d2c9', '9f840ac3-2134-445c-8acb-f9aabd286bc2', '9ee048f0-79e5-4cf1-aaa1-95c4c15213ce', 'afe772db-18a0-45c7-a0c4-2ec76a144f8c'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:40 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:26:40 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:40 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372" returned: 0 in 0.650s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:40 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.info Jun 04 13:26:40 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:40 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.632s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:40 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:26:40 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Deleted volume successfully. Jun 04 13:26:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fdab1966-1836-475b-9a0a-d22c3ec6e036 tempest-VolumesActionsTest-622811305 None] Lock "cinder-a39503f6-1033-47a7-a895-94d94aacb97c-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:40 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.info" returned: 0 in 0.664s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:40 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.info is being set with open permissions: ugo+rw Jun 04 13:26:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:40 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.info Jun 04 13:26:40 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:41 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.info" returned: 0 in 0.671s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.274s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.648s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1325769287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b84632-4f1b-4c3b-8911-c5f437a888e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='642dfe62cc1143ae995bfe4c16b7add6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:26:30Z,use_quota=True,user_id='7e64f6a47ff148d3a18bbd96fe48d528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:26:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Creating volume c4b84632-4f1b-4c3b-8911-c5f437a888e2 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:26:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:26:41 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:26:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:41 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2 1073741824 Jun 04 13:26:41 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:41 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b6350926-0aa1-4ba8-a86b-e423e5a0ef23 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Create snapshot completed successfully Jun 04 13:26:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Acquiring lock "cinder-adc7e0b8-f27f-4f9b-92cd-97e1e1c08372-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "cinder-adc7e0b8-f27f-4f9b-92cd-97e1e1c08372-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Acquiring lock "cinder-quobyte-5b5597e3-b918-40a9-9777-42453ba07d5d" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "cinder-quobyte-5b5597e3-b918-40a9-9777-42453ba07d5d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Acquiring lock "cinder-quobyte-adc7e0b8-f27f-4f9b-92cd-97e1e1c08372" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "cinder-quobyte-adc7e0b8-f27f-4f9b-92cd-97e1e1c08372" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Deleting offline snapshot adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 of volume 5b5597e3-b918-40a9-9777-42453ba07d5d {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:26:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] snapshot_file for this snap is: volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:26:42 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2 1073741824" returned: 0 in 0.941s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:42 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e8b750-50f2-4844-8ce0-edae90e32dbb]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:42 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2 Jun 04 13:26:42 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:42 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 Jun 04 13:26:42 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:43 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2" returned: 0 in 0.662s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-8763ad7d-9dc4-4748-9116-bf4a5980a621 req-41385785-e750-4239-9d50-47bd97e425fb tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.102s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:43 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97918475-a68f-43b5-97a7-7234288a080b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccaa2582-01e3-4067-958a-e2451e039f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ff9b64-9b91-4679-8e8a-275fcb74fcb5]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-8763ad7d-9dc4-4748-9116-bf4a5980a621 req-41385785-e750-4239-9d50-47bd97e425fb tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372" returned: 0 in 0.762s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b5597e3-b918-40a9-9777-42453ba07d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:26:43 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Volume volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2 (c4b84632-4f1b-4c3b-8911-c5f437a888e2): created successfully Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccaa2582-01e3-4067-958a-e2451e039f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Flow 'volume_create_manager' (1c05c68d-1500-4dd2-859c-9f844c232eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3cf1a2-00a4-402f-a988-a08368d74c7d]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:43 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-89d4000f-bd77-46bf-904c-aba57f1adcbd tempest-VolumesTransfersV355Test-326575468 None] Created volume successfully. Jun 04 13:26:43 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397 Jun 04 13:26:43 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:43 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d Jun 04 13:26:43 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:44 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Acquiring lock "cinder-c4b84632-4f1b-4c3b-8911-c5f437a888e2-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:44 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Lock "cinder-c4b84632-4f1b-4c3b-8911-c5f437a888e2-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:44 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Acquiring lock "cinder-quobyte-c4b84632-4f1b-4c3b-8911-c5f437a888e2" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:44 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Lock "cinder-quobyte-c4b84632-4f1b-4c3b-8911-c5f437a888e2" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:44 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[93307d6b-a60a-484d-8fb2-b2aaaddf70de]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:44 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-8763ad7d-9dc4-4748-9116-bf4a5980a621 req-41385785-e750-4239-9d50-47bd97e425fb tempest-AttachVolumeNegativeTest-351245229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397" returned: 0 in 0.987s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-8763ad7d-9dc4-4748-9116-bf4a5980a621 req-41385785-e750-4239-9d50-47bd97e425fb tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.017s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-8763ad7d-9dc4-4748-9116-bf4a5980a621 req-41385785-e750-4239-9d50-47bd97e425fb tempest-AttachVolumeNegativeTest-351245229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-c2f19220-7d00-406b-bf08-b06c42ebb397', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fd7b988-bf7e-485b-b7be-9362c42ab485', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:26:44 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d" returned: 0 in 0.980s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:44 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 Jun 04 13:26:44 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:44 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2 Jun 04 13:26:44 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:44 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-8763ad7d-9dc4-4748-9116-bf4a5980a621 req-41385785-e750-4239-9d50-47bd97e425fb tempest-AttachVolumeNegativeTest-351245229 None] attachment_update completed successfully. Jun 04 13:26:45 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2" returned: 0 in 1.036s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:45 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372" returned: 0 in 0.918s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:45 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2 Jun 04 13:26:45 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:45 devstack sudo[96971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372 Jun 04 13:26:45 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:45 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c4b84632-4f1b-4c3b-8911-c5f437a888e2" returned: 0 in 0.717s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Lock "cinder-quobyte-c4b84632-4f1b-4c3b-8911-c5f437a888e2" released by "delete_volume" :: held 1.814s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:45 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d.adc7e0b8-f27f-4f9b-92cd-97e1e1c08372" returned: 0 in 0.749s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "cinder-quobyte-adc7e0b8-f27f-4f9b-92cd-97e1e1c08372" released by "_delete_snapshot" :: held 3.577s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "cinder-quobyte-5b5597e3-b918-40a9-9777-42453ba07d5d" released by "delete_snapshot" :: held 3.605s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Created reservations ['f7fc64ab-5a15-4c44-974c-83c375b57370', '6fdbca69-0b2f-415b-9ba8-d31937907202', 'e285c247-6057-43c0-a24d-b2b6013e8240', '0fef375e-72a4-4740-88ed-6d56654fe7fe'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Created reservations ['bf82cc89-e651-42cb-b2c3-90c137077249', '46db6306-cfa4-4948-918c-8e36bc5987ca', '29a4d25f-602a-438a-aea1-4ae6dda3a32a', '3d540c87-551a-4e7f-a890-f40a43d555e2'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:26:46 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:26:46 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:46 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Delete snapshot completed successfully. Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b52efa43-5702-413c-a407-70d9320f6c57 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "cinder-adc7e0b8-f27f-4f9b-92cd-97e1e1c08372-delete_snapshot" released by "delete_snapshot" :: held 3.826s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Acquiring lock "cinder-5b5597e3-b918-40a9-9777-42453ba07d5d-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "cinder-5b5597e3-b918-40a9-9777-42453ba07d5d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:46 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.768s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Acquiring lock "cinder-quobyte-5b5597e3-b918-40a9-9777-42453ba07d5d" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:46 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Deleted volume successfully. Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "cinder-quobyte-5b5597e3-b918-40a9-9777-42453ba07d5d" acquired by "delete_volume" :: waited 0.026s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9cb34581-9090-48d3-be16-4d8f13367983 tempest-VolumesTransfersV355Test-229990852 None] Lock "cinder-c4b84632-4f1b-4c3b-8911-c5f437a888e2-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec33a4-1fa2-43c4-aae1-297c5d5b1d25]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:47 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d Jun 04 13:26:47 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:47 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d" returned: 0 in 0.832s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:47 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d Jun 04 13:26:47 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:47 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:26:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Flow 'volume_create_manager' (6e53bbc0-83c1-4ef2-9601-7e84ca9e3db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:26:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaef49cc-9ded-4729-b32e-1fe2975381a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaef49cc-9ded-4729-b32e-1fe2975381a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1565767803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83a0370-eb7d-4944-abbd-8701ff5fe869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9285da3873f84780b4bdd743ca92c80e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:26:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:26:48Z,use_quota=True,user_id='7bdcb751631b447cbacc0ea563c3b62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e9428a-ff6f-4ace-9c72-a79bf4c71863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e9428a-ff6f-4ace-9c72-a79bf4c71863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deb721a-1651-480c-949b-a6baa05fb84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deb721a-1651-480c-949b-a6baa05fb84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83a0370-eb7d-4944-abbd-8701ff5fe869', 'volume_name': 'volume-b83a0370-eb7d-4944-abbd-8701ff5fe869', 'volume_size': 2}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01d33f3-c1dd-4351-a08e-be59e67ce486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e01d33f3-c1dd-4351-a08e-be59e67ce486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c6b5d2-47c5-48da-9744-55557b6fb398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:48 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Volume b83a0370-eb7d-4944-abbd-8701ff5fe869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83a0370-eb7d-4944-abbd-8701ff5fe869', 'volume_size': 2} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1565767803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83a0370-eb7d-4944-abbd-8701ff5fe869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9285da3873f84780b4bdd743ca92c80e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:26:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:26:48Z,use_quota=True,user_id='7bdcb751631b447cbacc0ea563c3b62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Creating volume b83a0370-eb7d-4944-abbd-8701ff5fe869 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:26:48 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b83a0370-eb7d-4944-abbd-8701ff5fe869 2147483648 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:48 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b83a0370-eb7d-4944-abbd-8701ff5fe869 2147483648 Jun 04 13:26:48 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:48 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5b5597e3-b918-40a9-9777-42453ba07d5d" returned: 0 in 0.835s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "cinder-quobyte-5b5597e3-b918-40a9-9777-42453ba07d5d" released by "delete_volume" :: held 1.759s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Created reservations ['dfd5da05-a598-4e61-9cde-e4158fce88ee', 'd2c97278-edd1-4a35-a033-f645ce5ec3e6', '6de86a46-ffc5-4f86-b356-c65adbbee8f1', 'a98ae15b-b21e-4aa3-a722-c36dfa226b79'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:48 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:26:48 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:49 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b83a0370-eb7d-4944-abbd-8701ff5fe869 2147483648" returned: 0 in 1.285s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b83a0370-eb7d-4944-abbd-8701ff5fe869 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:49 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b83a0370-eb7d-4944-abbd-8701ff5fe869 Jun 04 13:26:49 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:49 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.016s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:49 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:26:49 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Deleted volume successfully. Jun 04 13:26:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6f96356e-bc81-4029-8489-ec6ac27a8dd5 tempest-VolumesSnapshotNegativeTestJSON-1229155710 None] Lock "cinder-5b5597e3-b918-40a9-9777-42453ba07d5d-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:50 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b83a0370-eb7d-4944-abbd-8701ff5fe869" returned: 0 in 1.007s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] <== create_volume: return (2359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:26:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.361s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4c6b5d2-47c5-48da-9744-55557b6fb398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83a0370-eb7d-4944-abbd-8701ff5fe869', 'volume_size': 2}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794c7af0-5b03-4e3b-a8a5-d525bbafd527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:50 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Volume volume-b83a0370-eb7d-4944-abbd-8701ff5fe869 (b83a0370-eb7d-4944-abbd-8701ff5fe869): created successfully Jun 04 13:26:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794c7af0-5b03-4e3b-a8a5-d525bbafd527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Flow 'volume_create_manager' (6e53bbc0-83c1-4ef2-9601-7e84ca9e3db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:26:50 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-05f07747-0382-49c4-988f-cbe641d58507 tempest-VolumesCloneNegativeTest-1968574247 None] Created volume successfully. Jun 04 13:26:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-456e3a6c-ffa9-40d6-8442-bee7f4adcbd6 req-92f8f3f8-0ed9-45d5-8706-c1fbca362714 tempest-AttachVolumeNegativeTest-351245229 None] Terminate volume connection completed successfully. Jun 04 13:26:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-456e3a6c-ffa9-40d6-8442-bee7f4adcbd6 req-92f8f3f8-0ed9-45d5-8706-c1fbca362714 tempest-AttachVolumeNegativeTest-351245229 None] Deleting attachment 8fd7b988-bf7e-485b-b7be-9362c42ab485. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:26:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Acquiring lock "cinder-b83a0370-eb7d-4944-abbd-8701ff5fe869-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Lock "cinder-b83a0370-eb7d-4944-abbd-8701ff5fe869-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Acquiring lock "cinder-quobyte-b83a0370-eb7d-4944-abbd-8701ff5fe869" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:26:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Lock "cinder-quobyte-b83a0370-eb7d-4944-abbd-8701ff5fe869" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:26:51 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd80f1c-93db-4d10-bb4d-106f018ee051]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:26:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b83a0370-eb7d-4944-abbd-8701ff5fe869 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:51 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b83a0370-eb7d-4944-abbd-8701ff5fe869 Jun 04 13:26:51 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:52 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b83a0370-eb7d-4944-abbd-8701ff5fe869" returned: 0 in 0.827s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b83a0370-eb7d-4944-abbd-8701ff5fe869 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:52 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b83a0370-eb7d-4944-abbd-8701ff5fe869 Jun 04 13:26:52 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:52 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b83a0370-eb7d-4944-abbd-8701ff5fe869" returned: 0 in 0.669s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Lock "cinder-quobyte-b83a0370-eb7d-4944-abbd-8701ff5fe869" released by "delete_volume" :: held 1.559s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=79,cinder:INSERT=20,cinder:UPDATE=79,cinder:DELETE=5 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Created reservations ['33d86ce2-5e47-4979-8251-1df459386da8', 'ed78419e-9b13-42f9-9f0b-d04e8e0dde4e', '3c74182d-80ab-4695-b201-db34acecbfac', 'e58e76b5-6365-498d-b398-41f209441796'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:53 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:26:53 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Flow 'volume_create_manager' (a9dd3fe7-7e59-475f-a29a-a7b3971a5d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd2e1b6-0a97-44a1-aa46-04ae16a45735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd2e1b6-0a97-44a1-aa46-04ae16a45735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-611085986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855afac6-40d7-45ed-8720-5cdcb352e8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14a62c3384146029b6321c91d75ac35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:26:53Z,use_quota=True,user_id='8dddd154c9bd44a9ad99f279df6b8818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493084a9-a465-4a46-aaa3-5b241eac9475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493084a9-a465-4a46-aaa3-5b241eac9475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1530c8-4cfa-4752-ae2e-93d5189dfaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1530c8-4cfa-4752-ae2e-93d5189dfaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '855afac6-40d7-45ed-8720-5cdcb352e8d4', 'volume_name': 'volume-855afac6-40d7-45ed-8720-5cdcb352e8d4', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2465763b-2866-4303-9c7e-544fd884ba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2465763b-2866-4303-9c7e-544fd884ba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edf77ca-83a2-4a87-aa47-4699e996a681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:53 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Volume 855afac6-40d7-45ed-8720-5cdcb352e8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-855afac6-40d7-45ed-8720-5cdcb352e8d4', 'volume_size': 1} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-611085986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855afac6-40d7-45ed-8720-5cdcb352e8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c14a62c3384146029b6321c91d75ac35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:26:53Z,use_quota=True,user_id='8dddd154c9bd44a9ad99f279df6b8818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Creating volume 855afac6-40d7-45ed-8720-5cdcb352e8d4 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:26:53 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:26:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-855afac6-40d7-45ed-8720-5cdcb352e8d4 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:53 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-855afac6-40d7-45ed-8720-5cdcb352e8d4 1073741824 Jun 04 13:26:53 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:54 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.094s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:54 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:26:54 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Deleted volume successfully. Jun 04 13:26:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3162f15f-00cf-4518-8f7f-670407573e58 tempest-VolumesCloneNegativeTest-1968574247 None] Lock "cinder-b83a0370-eb7d-4944-abbd-8701ff5fe869-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:26:54 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-855afac6-40d7-45ed-8720-5cdcb352e8d4 1073741824" returned: 0 in 1.084s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-855afac6-40d7-45ed-8720-5cdcb352e8d4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:26:54 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-855afac6-40d7-45ed-8720-5cdcb352e8d4 Jun 04 13:26:54 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:26:55 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Jun 04 13:26:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-855afac6-40d7-45ed-8720-5cdcb352e8d4" returned: 0 in 0.811s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:26:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:26:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:26:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edf77ca-83a2-4a87-aa47-4699e996a681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-855afac6-40d7-45ed-8720-5cdcb352e8d4', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04565e5e-ab6d-47f2-aa40-34d1f002c212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:26:55 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Volume volume-855afac6-40d7-45ed-8720-5cdcb352e8d4 (855afac6-40d7-45ed-8720-5cdcb352e8d4): created successfully Jun 04 13:26:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04565e5e-ab6d-47f2-aa40-34d1f002c212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:26:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Flow 'volume_create_manager' (a9dd3fe7-7e59-475f-a29a-a7b3971a5d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:26:55 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-56d3eba4-e089-4caf-b1c6-ab5d159cef45 tempest-VolumesNegativeTest-509210944 None] Created volume successfully. Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Flow 'volume_create_manager' (30b0a101-80dd-488c-be29-bb974ed43e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34959097-432e-46f4-a088-072e6318316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34959097-432e-46f4-a088-072e6318316c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-523116091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631c17a7-4551-4019-9a73-ac5a7ca62334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32656046ff2d4e2294fb8832b3b4a020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:00Z,use_quota=True,user_id='c744a9f515ba45ce85ac7f60425fd350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a34a21-e27f-48e1-9742-6bec7425fbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a34a21-e27f-48e1-9742-6bec7425fbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9b6060-4a1d-41b5-8bdc-c756bbfa7d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9b6060-4a1d-41b5-8bdc-c756bbfa7d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631c17a7-4551-4019-9a73-ac5a7ca62334', 'volume_name': 'volume-631c17a7-4551-4019-9a73-ac5a7ca62334', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc12f56d-5cd4-44e3-b449-209f00d10794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc12f56d-5cd4-44e3-b449-209f00d10794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef25653-cd05-4b88-867d-75db39114b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:00 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Volume 631c17a7-4551-4019-9a73-ac5a7ca62334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631c17a7-4551-4019-9a73-ac5a7ca62334', 'volume_size': 1} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-523116091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631c17a7-4551-4019-9a73-ac5a7ca62334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32656046ff2d4e2294fb8832b3b4a020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:00Z,use_quota=True,user_id='c744a9f515ba45ce85ac7f60425fd350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Creating volume 631c17a7-4551-4019-9a73-ac5a7ca62334 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:27:00 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:27:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:00 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 1073741824 Jun 04 13:27:00 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:01 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 1073741824" returned: 0 in 0.966s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:01 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 Jun 04 13:27:01 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:02 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334" returned: 0 in 0.690s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:27:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef25653-cd05-4b88-867d-75db39114b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631c17a7-4551-4019-9a73-ac5a7ca62334', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81af1294-9d7c-4c26-bb71-afedecde2797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:02 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Volume volume-631c17a7-4551-4019-9a73-ac5a7ca62334 (631c17a7-4551-4019-9a73-ac5a7ca62334): created successfully Jun 04 13:27:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81af1294-9d7c-4c26-bb71-afedecde2797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Flow 'volume_create_manager' (30b0a101-80dd-488c-be29-bb974ed43e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:02 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c0ce1f34-d273-4216-8f86-eae7a277ea94 tempest-VolumesSnapshotListTestJSON-352749907 None] Created volume successfully. Jun 04 13:27:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] Creating offline snapshot cd0317d6-f253-48bd-b007-a188e3c2c605 of volume 631c17a7-4551-4019-9a73-ac5a7ca62334 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:27:03 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb6e76f-1fe8-4a80-a815-177a828e9bae]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:03 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 Jun 04 13:27:03 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:03 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334" returned: 0 in 0.955s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:03 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 1G Jun 04 13:27:04 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:27:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:04 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:27:04 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:04 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.762s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:27:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:27:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:27:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:27:05 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 1G" returned: 0 in 1.271s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631c17a7-4551-4019-9a73-ac5a7ca62334 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:05 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631c17a7-4551-4019-9a73-ac5a7ca62334 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 Jun 04 13:27:05 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:05 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631c17a7-4551-4019-9a73-ac5a7ca62334 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605" returned: 0 in 0.743s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:05 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 is being set with open permissions: ugo+rw Jun 04 13:27:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:06 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 Jun 04 13:27:06 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:06 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605" returned: 0 in 0.647s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:06 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.info Jun 04 13:27:06 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:07 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.info" returned: 0 in 0.615s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:07 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.info is being set with open permissions: ugo+rw Jun 04 13:27:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:07 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.info Jun 04 13:27:07 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:08 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.info" returned: 0 in 0.647s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.084s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:08 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1a7bfc0c-c2ad-432a-8676-3fcbde7c5192 tempest-VolumesSnapshotListTestJSON-352749907 None] Create snapshot completed successfully Jun 04 13:27:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:10 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] Creating offline snapshot 9e1aae73-dcbe-49e9-bb00-989a0f2d5498 of volume 631c17a7-4551-4019-9a73-ac5a7ca62334 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:27:10 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f71efb3-cad6-4f64-beb1-38aac09ccc28]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:10 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 Jun 04 13:27:10 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:10 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605" returned: 0 in 0.764s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:10 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-631c17a7-4551-4019-9a73-ac5a7ca62334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:27:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:11 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 1G Jun 04 13:27:11 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:11 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 1G" returned: 0 in 0.961s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:11 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 Jun 04 13:27:11 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:12 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498" returned: 0 in 0.813s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:12 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 is being set with open permissions: ugo+rw Jun 04 13:27:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:12 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 Jun 04 13:27:12 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:13 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498" returned: 0 in 0.725s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:13 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=49,cinder:UPDATE=76,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:27:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.417s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:13 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-07b9e10c-6429-4396-8a23-bf7583e57939 tempest-VolumesSnapshotListTestJSON-352749907 None] Create snapshot completed successfully Jun 04 13:27:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] Creating offline snapshot 3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b of volume 631c17a7-4551-4019-9a73-ac5a7ca62334 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:27:14 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5102cf2d-dce1-40f2-9d69-c722d7f852f7]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:14 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 Jun 04 13:27:14 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:15 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498" returned: 0 in 1.345s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-631c17a7-4551-4019-9a73-ac5a7ca62334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:27:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:15 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b 1G Jun 04 13:27:15 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:16 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b 1G" returned: 0 in 1.128s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:17 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b Jun 04 13:27:17 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:17 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b" returned: 0 in 0.851s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:17 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b is being set with open permissions: ugo+rw Jun 04 13:27:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:17 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b Jun 04 13:27:17 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:18 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b" returned: 0 in 0.712s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.167s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:18 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1090ec15-f628-4ed5-a408-ea9228dc9a00 tempest-VolumesSnapshotListTestJSON-352749907 None] Create snapshot completed successfully Jun 04 13:27:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "cinder-3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "cinder-quobyte-631c17a7-4551-4019-9a73-ac5a7ca62334" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-631c17a7-4551-4019-9a73-ac5a7ca62334" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "cinder-quobyte-3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Deleting offline snapshot 3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b of volume 631c17a7-4551-4019-9a73-ac5a7ca62334 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:27:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] snapshot_file for this snap is: volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:27:19 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[72013c4e-e5f4-4abf-9d9b-868e1d408a3a]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:20 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b Jun 04 13:27:20 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:21 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b" returned: 0 in 1.240s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-631c17a7-4551-4019-9a73-ac5a7ca62334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:27:21 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b6e1b8-f5cc-4ca8-b9a2-1d2085fc3435]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:21 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 Jun 04 13:27:21 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:22 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498" returned: 0 in 1.062s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-631c17a7-4551-4019-9a73-ac5a7ca62334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:27:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:22 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b Jun 04 13:27:22 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:23 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b" returned: 0 in 1.308s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:23 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b Jun 04 13:27:23 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:24 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b" returned: 0 in 0.825s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b" released by "_delete_snapshot" :: held 4.628s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:24 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=17,cinder:SELECT=15,cinder:INSERT=1,cinder:DELETE=4 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:27:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-631c17a7-4551-4019-9a73-ac5a7ca62334" released by "delete_snapshot" :: held 4.663s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:24 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Created reservations ['bfa2633e-6bb4-4f3a-88ab-abab940c5f67', 'c463b76b-be68-4862-a0e5-62885cb91a94', '3b2b13f8-5e3d-406a-a71d-ab496e35a63e', 'c93668fa-eb68-4b59-a4d2-c1a2e0f3b3ea'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:27:24 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Delete snapshot completed successfully. Jun 04 13:27:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4e479690-7bce-4b2f-b766-9281189f4aa3 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-3bcb91dd-9fc5-4b76-a3a2-133ac3e0a51b-delete_snapshot" released by "delete_snapshot" :: held 5.089s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "cinder-9e1aae73-dcbe-49e9-bb00-989a0f2d5498-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-9e1aae73-dcbe-49e9-bb00-989a0f2d5498-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "cinder-quobyte-631c17a7-4551-4019-9a73-ac5a7ca62334" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-631c17a7-4551-4019-9a73-ac5a7ca62334" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "cinder-quobyte-9e1aae73-dcbe-49e9-bb00-989a0f2d5498" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-9e1aae73-dcbe-49e9-bb00-989a0f2d5498" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Deleting offline snapshot 9e1aae73-dcbe-49e9-bb00-989a0f2d5498 of volume 631c17a7-4551-4019-9a73-ac5a7ca62334 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:27:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] snapshot_file for this snap is: volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:27:25 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[419aeca8-9dd6-4d0e-9e7f-292af517dc62]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:25 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 Jun 04 13:27:25 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Flow 'volume_create_manager' (3fcf78b7-c67a-4211-8825-79751ff3131e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b934d5-0337-43a1-b450-35763b640be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b934d5-0337-43a1-b450-35763b640be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1725450679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4474d28a-6a15-49f4-9af4-1c5bbb50a246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f41a9b9ec104f069f0b0ebf8eb0efd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:27Z,use_quota=True,user_id='48ed3203736b4ab9a51be01b55d2bcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03472b77-bd97-4d02-a917-498212c612b8),volume_type_id=03472b77-bd97-4d02-a917-498212c612b8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0158168-9803-4a1b-a2a8-419d46ffbfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0158168-9803-4a1b-a2a8-419d46ffbfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954c72ab-ce3c-4df4-b51e-9716e440d9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954c72ab-ce3c-4df4-b51e-9716e440d9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4474d28a-6a15-49f4-9af4-1c5bbb50a246', 'volume_name': 'volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21dcd6c-e00f-43d4-b70a-22f0c5bc8a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21dcd6c-e00f-43d4-b70a-22f0c5bc8a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45101a14-40d4-42b0-b98f-610d4c284b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:27 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Volume 4474d28a-6a15-49f4-9af4-1c5bbb50a246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246', 'volume_size': 1} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1725450679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4474d28a-6a15-49f4-9af4-1c5bbb50a246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f41a9b9ec104f069f0b0ebf8eb0efd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:27Z,use_quota=True,user_id='48ed3203736b4ab9a51be01b55d2bcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(03472b77-bd97-4d02-a917-498212c612b8),volume_type_id=03472b77-bd97-4d02-a917-498212c612b8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Creating volume 4474d28a-6a15-49f4-9af4-1c5bbb50a246 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:27:27 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:27 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246 1073741824 Jun 04 13:27:27 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:27 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498" returned: 0 in 2.469s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-631c17a7-4551-4019-9a73-ac5a7ca62334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9da3ad-260c-419d-807b-2bf3ddaf6629]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:28 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 Jun 04 13:27:28 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Flow 'volume_create_manager' (aa7e548e-384e-47f0-8700-5dbba2904dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de22f8a8-56f2-4129-93c4-4c9486a0eea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de22f8a8-56f2-4129-93c4-4c9486a0eea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1078790628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaec12b-295a-4986-af8d-7d80dc2650f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f41a9b9ec104f069f0b0ebf8eb0efd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:28Z,use_quota=True,user_id='48ed3203736b4ab9a51be01b55d2bcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57376e19-d2b6-4396-94f6-3c5476e2a0ef),volume_type_id=57376e19-d2b6-4396-94f6-3c5476e2a0ef)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01d92b2-f032-4446-86c4-d031a778e920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01d92b2-f032-4446-86c4-d031a778e920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d749a9-f4be-45df-a871-405440760a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d749a9-f4be-45df-a871-405440760a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eaec12b-295a-4986-af8d-7d80dc2650f1', 'volume_name': 'volume-0eaec12b-295a-4986-af8d-7d80dc2650f1', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3de0d3a-64a9-460e-8132-7b119c858ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3de0d3a-64a9-460e-8132-7b119c858ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87650d41-55a3-417a-83f7-cf4a7af94c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:28 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Volume 0eaec12b-295a-4986-af8d-7d80dc2650f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eaec12b-295a-4986-af8d-7d80dc2650f1', 'volume_size': 1} Jun 04 13:27:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:29 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246 1073741824" returned: 0 in 1.604s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:29 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246 Jun 04 13:27:29 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:29 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605" returned: 0 in 1.383s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-631c17a7-4551-4019-9a73-ac5a7ca62334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:29 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 Jun 04 13:27:29 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Flow 'volume_create_manager' (89857e90-06bd-496e-816e-1a6eecb748f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c3a608-c614-4559-bdca-c5e5e0c8d5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27c3a608-c614-4559-bdca-c5e5e0c8d5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2008952417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673a3b54-95b2-4ad4-b70e-92965b8c1db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f41a9b9ec104f069f0b0ebf8eb0efd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:29Z,use_quota=True,user_id='48ed3203736b4ab9a51be01b55d2bcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c25479b-2fcf-4485-94dd-a2ccafd31127),volume_type_id=7c25479b-2fcf-4485-94dd-a2ccafd31127)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551beef1-8152-47d9-87c1-1848f735f802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551beef1-8152-47d9-87c1-1848f735f802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bba865-1b87-43af-bccb-49220804cf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:29 devstack cinder-volume[86722]: DEBUG cinder.image.glance [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Creating Keystone auth plugin from conf {{(pid=86722) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1bba865-1b87-43af-bccb-49220804cf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '673a3b54-95b2-4ad4-b70e-92965b8c1db9', 'volume_name': 'volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9', 'volume_size': 1, 'image_id': 'b99646ea-dc59-437b-946b-587b029228dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b99646ea-dc59-437b-946b-587b029228dd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--638072306', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9f41a9b9ec104f069f0b0ebf8eb0efd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b99646ea-dc59-437b-946b-587b029228dd', 'created_at': datetime.datetime(2026, 6, 4, 11, 27, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 27, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b99646ea-dc59-437b-946b-587b029228dd/file', 'properties': {}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (953d932e-cf8b-4821-94cb-f03f0fcc4291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (953d932e-cf8b-4821-94cb-f03f0fcc4291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c001c5aa-fab6-4138-a9b0-ba4b44a9012c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:30 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Volume 673a3b54-95b2-4ad4-b70e-92965b8c1db9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9', 'volume_size': 1, 'image_id': 'b99646ea-dc59-437b-946b-587b029228dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b99646ea-dc59-437b-946b-587b029228dd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--638072306', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9f41a9b9ec104f069f0b0ebf8eb0efd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b99646ea-dc59-437b-946b-587b029228dd', 'created_at': datetime.datetime(2026, 6, 4, 11, 27, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 27, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b99646ea-dc59-437b-946b-587b029228dd/file', 'properties': {}}, 'image_service': } Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Trying to clone 673a3b54-95b2-4ad4-b70e-92965b8c1db9 from image b99646ea-dc59-437b-946b-587b029228dd at location (None, [{'url': 'file:///opt/stack/data/glance/images/b99646ea-dc59-437b-946b-587b029228dd', 'metadata': {}}]). {{(pid=86722) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 13:27:30 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246" returned: 0 in 0.974s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] <== create_volume: return (2694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.702s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1078790628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eaec12b-295a-4986-af8d-7d80dc2650f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f41a9b9ec104f069f0b0ebf8eb0efd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:28Z,use_quota=True,user_id='48ed3203736b4ab9a51be01b55d2bcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57376e19-d2b6-4396-94f6-3c5476e2a0ef),volume_type_id=57376e19-d2b6-4396-94f6-3c5476e2a0ef)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Creating volume 0eaec12b-295a-4986-af8d-7d80dc2650f1 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:27:30 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45101a14-40d4-42b0-b98f-610d4c284b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50802a6e-ca90-4149-87dc-eee3d10b55ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:30 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1 1073741824 Jun 04 13:27:30 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:30 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Volume volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246 (4474d28a-6a15-49f4-9af4-1c5bbb50a246): created successfully Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50802a6e-ca90-4149-87dc-eee3d10b55ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Flow 'volume_create_manager' (3fcf78b7-c67a-4211-8825-79751ff3131e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:30 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ec44774f-d8ad-4b32-a3ce-9607641fbe11 tempest-TestInstancesWithCinderVolumes-1788480100 None] Created volume successfully. Jun 04 13:27:30 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498" returned: 0 in 1.256s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:30 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498 Jun 04 13:27:30 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:31 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1 1073741824" returned: 0 in 1.311s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:31 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.9e1aae73-dcbe-49e9-bb00-989a0f2d5498" returned: 0 in 0.929s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:31 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1 Jun 04 13:27:31 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:31 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-9e1aae73-dcbe-49e9-bb00-989a0f2d5498" released by "_delete_snapshot" :: held 6.278s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:31 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-631c17a7-4551-4019-9a73-ac5a7ca62334" released by "delete_snapshot" :: held 6.344s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:31 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Created reservations ['ad40f09e-95af-4d7f-8e4e-4fecb21c7a54', '664b558a-d8a1-409b-8136-c6720d6ecb42', 'b5f83766-b856-422d-9df5-af05430f4b48', 'f2924a31-29bd-4313-b3e6-2c99ca288797'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:27:31 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Delete snapshot completed successfully. Jun 04 13:27:31 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ecf23773-f047-46fc-a72f-75291078206e tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-9e1aae73-dcbe-49e9-bb00-989a0f2d5498-delete_snapshot" released by "delete_snapshot" :: held 6.692s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "cinder-cd0317d6-f253-48bd-b007-a188e3c2c605-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-cd0317d6-f253-48bd-b007-a188e3c2c605-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "cinder-quobyte-631c17a7-4551-4019-9a73-ac5a7ca62334" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-631c17a7-4551-4019-9a73-ac5a7ca62334" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "cinder-quobyte-cd0317d6-f253-48bd-b007-a188e3c2c605" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-cd0317d6-f253-48bd-b007-a188e3c2c605" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Deleting offline snapshot cd0317d6-f253-48bd-b007-a188e3c2c605 of volume 631c17a7-4551-4019-9a73-ac5a7ca62334 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] snapshot_file for this snap is: volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcdd7ea-786a-486b-ae44-4cad3c18c075]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:32 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 Jun 04 13:27:32 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:32 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1" returned: 0 in 1.350s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] <== create_volume: return (2790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.794s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87650d41-55a3-417a-83f7-cf4a7af94c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eaec12b-295a-4986-af8d-7d80dc2650f1', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4764bebb-2771-4da5-ac6a-e3aba579c6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:32 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Volume volume-0eaec12b-295a-4986-af8d-7d80dc2650f1 (0eaec12b-295a-4986-af8d-7d80dc2650f1): created successfully Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4764bebb-2771-4da5-ac6a-e3aba579c6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Flow 'volume_create_manager' (aa7e548e-384e-47f0-8700-5dbba2904dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:32 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-4cc1843a-9ac9-44bf-8b9d-b007aa0fa88d tempest-TestInstancesWithCinderVolumes-1788480100 None] Created volume successfully. Jun 04 13:27:33 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605" returned: 0 in 1.198s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-631c17a7-4551-4019-9a73-ac5a7ca62334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:27:33 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a318cd7-d2db-4eeb-8bd9-35d065fa8dd8]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:33 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 Jun 04 13:27:33 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:34 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334" returned: 0 in 1.014s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:34 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 Jun 04 13:27:34 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:35 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605" returned: 0 in 0.882s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:35 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605 Jun 04 13:27:35 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:35 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD, size 20.69 MB, duration 5.54 sec {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 13:27:35 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Image download 20.69 MB at 3.73 MB/s Jun 04 13:27:35 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d0e48f-6075-472f-9a02-a116be8f218d]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:35 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD Jun 04 13:27:35 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:36 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334.cd0317d6-f253-48bd-b007-a188e3c2c605" returned: 0 in 0.753s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-cd0317d6-f253-48bd-b007-a188e3c2c605" released by "_delete_snapshot" :: held 4.019s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-631c17a7-4551-4019-9a73-ac5a7ca62334" released by "delete_snapshot" :: held 4.087s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Created reservations ['9efbd9ec-af3c-4a59-94a3-1fe150fd3920', '09f5cb04-4cbb-4348-b632-915969557af0', '936b55de-a30d-44e3-818c-be789242b1b0', 'aab6ac39-3cf2-4aa9-9728-eb41e8a148c8'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:27:36 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Delete snapshot completed successfully. Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7358c76-8889-42d8-8043-57d73a007149 tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-cd0317d6-f253-48bd-b007-a188e3c2c605-delete_snapshot" released by "delete_snapshot" :: held 4.314s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "cinder-631c17a7-4551-4019-9a73-ac5a7ca62334-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:36 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD" returned: 0 in 0.985s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Temporary image b99646ea-dc59-437b-946b-587b029228dd is fetched for user 48ed3203736b4ab9a51be01b55d2bcec. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-631c17a7-4551-4019-9a73-ac5a7ca62334-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "cinder-quobyte-631c17a7-4551-4019-9a73-ac5a7ca62334" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-631c17a7-4551-4019-9a73-ac5a7ca62334" acquired by "delete_volume" :: waited 0.024s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8f5f69-96a2-488f-84ab-f09f2f84f576]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[26edad29-5abd-49e4-92be-e12275d14eba]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:36 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 Jun 04 13:27:36 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:36 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD Jun 04 13:27:36 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:37 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334" returned: 0 in 0.854s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:37 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334 Jun 04 13:27:37 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:38 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD" returned: 0 in 1.240s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2008952417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673a3b54-95b2-4ad4-b70e-92965b8c1db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f41a9b9ec104f069f0b0ebf8eb0efd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:29Z,use_quota=True,user_id='48ed3203736b4ab9a51be01b55d2bcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c25479b-2fcf-4485-94dd-a2ccafd31127),volume_type_id=7c25479b-2fcf-4485-94dd-a2ccafd31127)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Creating volume 673a3b54-95b2-4ad4-b70e-92965b8c1db9 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:27:38 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:38 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 1073741824 Jun 04 13:27:38 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:38 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-631c17a7-4551-4019-9a73-ac5a7ca62334" returned: 0 in 0.757s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-quobyte-631c17a7-4551-4019-9a73-ac5a7ca62334" released by "delete_volume" :: held 1.688s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Created reservations ['8f6ce209-9fbf-4d79-b052-4babaeb691dc', '81781ff6-a177-4211-b406-36bb95b7fd23', '4c5309d1-7291-4189-a5a5-276d74eb1af7', 'e23f0dd8-5c37-4644-9be6-19622428f8a2'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:38 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:27:38 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:39 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 1073741824" returned: 0 in 1.131s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:39 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 Jun 04 13:27:39 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:39 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.993s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:39 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:27:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Deleted volume successfully. Jun 04 13:27:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f3863781-e53c-494a-a3f0-6c32c3b02a7b tempest-VolumesSnapshotListTestJSON-352749907 None] Lock "cinder-631c17a7-4551-4019-9a73-ac5a7ca62334-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:40 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9" returned: 0 in 0.826s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:27:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:40 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Attempting download of b99646ea-dc59-437b-946b-587b029228dd ((None, [{'url': 'file:///opt/stack/data/glance/images/b99646ea-dc59-437b-946b-587b029228dd', 'metadata': {}}])) to volume 673a3b54-95b2-4ad4-b70e-92965b8c1db9. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 13:27:40 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d76bc6-9f5c-4b6a-ad9c-097dabeeaa2a]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b99646ea-dc59-437b-946b-587b029228dd_i0auaoxl {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Acquiring lock "cinder-855afac6-40d7-45ed-8720-5cdcb352e8d4-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Lock "cinder-855afac6-40d7-45ed-8720-5cdcb352e8d4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:40 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b99646ea-dc59-437b-946b-587b029228dd_i0auaoxl Jun 04 13:27:40 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Acquiring lock "cinder-quobyte-855afac6-40d7-45ed-8720-5cdcb352e8d4" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Lock "cinder-quobyte-855afac6-40d7-45ed-8720-5cdcb352e8d4" acquired by "delete_volume" :: waited 0.034s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:40 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[6312f462-705a-4b4a-8c16-0c513afd3f50]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-855afac6-40d7-45ed-8720-5cdcb352e8d4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:40 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-855afac6-40d7-45ed-8720-5cdcb352e8d4 Jun 04 13:27:40 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:41 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b99646ea-dc59-437b-946b-587b029228dd_i0auaoxl" returned: 0 in 0.735s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b99646ea-dc59-437b-946b-587b029228dd_i0auaoxl {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:41 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b99646ea-dc59-437b-946b-587b029228dd_i0auaoxl Jun 04 13:27:41 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:41 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-855afac6-40d7-45ed-8720-5cdcb352e8d4" returned: 0 in 0.868s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-855afac6-40d7-45ed-8720-5cdcb352e8d4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:41 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-855afac6-40d7-45ed-8720-5cdcb352e8d4 Jun 04 13:27:41 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:41 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b99646ea-dc59-437b-946b-587b029228dd_i0auaoxl" returned: 1 in 0.744s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b99646ea-dc59-437b-946b-587b029228dd_i0auaoxl' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:27:41 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3decdd82-98c4-49b4-b999-6b3f4f87fdb6]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:41 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD Jun 04 13:27:41 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:42 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-855afac6-40d7-45ed-8720-5cdcb352e8d4" returned: 0 in 0.710s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Lock "cinder-quobyte-855afac6-40d7-45ed-8720-5cdcb352e8d4" released by "delete_volume" :: held 1.644s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Created reservations ['2fd280ff-ef2f-437f-9424-5b7cc7ad02a3', '829cd1f6-94c1-4bed-aa65-5fe35fd545b0', 'a5fe5db0-6876-4f35-b53b-56763c4e3587', 'dd4bd7a5-53cd-48d1-84ba-cc4f3ceceb35'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:27:42 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:27:42 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Flow 'volume_create_manager' (88b1cb7e-a514-482a-9050-2b08b2f5e365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab300198-fe17-4654-9483-e2e751bef055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab300198-fe17-4654-9483-e2e751bef055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1814999357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182af7ba-1a42-465c-980a-405dd1c7cf9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19829fdd7d6f45888519d00289aeca0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:42Z,use_quota=True,user_id='32a1642e3c504ea8bad7eff40b7605c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d508b0b2-a7b2-46d5-af8d-5d01b2f661e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d508b0b2-a7b2-46d5-af8d-5d01b2f661e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8028106-a35a-42fc-8560-804d0ef12111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8028106-a35a-42fc-8560-804d0ef12111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182af7ba-1a42-465c-980a-405dd1c7cf9b', 'volume_name': 'volume-182af7ba-1a42-465c-980a-405dd1c7cf9b', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0751a4-0be7-4c2c-bbbf-c1534809af81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0751a4-0be7-4c2c-bbbf-c1534809af81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab91d55-51a5-4f4b-a9fa-62c390f0da3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:42 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Volume 182af7ba-1a42-465c-980a-405dd1c7cf9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182af7ba-1a42-465c-980a-405dd1c7cf9b', 'volume_size': 1} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1814999357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182af7ba-1a42-465c-980a-405dd1c7cf9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19829fdd7d6f45888519d00289aeca0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:42Z,use_quota=True,user_id='32a1642e3c504ea8bad7eff40b7605c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Creating volume 182af7ba-1a42-465c-980a-405dd1c7cf9b {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:27:42 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-182af7ba-1a42-465c-980a-405dd1c7cf9b 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:42 devstack sudo[97978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-182af7ba-1a42-465c-980a-405dd1c7cf9b 1073741824 Jun 04 13:27:42 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:27:42 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Flow 'volume_create_manager' (ababcf7f-652d-4669-ac1a-722131d628be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc93df06-0886-4c5b-94a8-f5d10b66684d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD" returned: 0 in 0.939s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] b99646ea-dc59-437b-946b-587b029228dd was qcow2, converting to raw {{(pid=86722) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc93df06-0886-4c5b-94a8-f5d10b66684d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1279018090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9423f6-b7d5-4c65-a295-e4634b6db5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19829fdd7d6f45888519d00289aeca0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:43Z,use_quota=True,user_id='32a1642e3c504ea8bad7eff40b7605c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c6cd89-aa57-4bbf-93f9-a36650da4398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c6cd89-aa57-4bbf-93f9-a36650da4398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:42 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 Jun 04 13:27:42 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d81f36-2ba1-4287-a390-56de3b2400d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d81f36-2ba1-4287-a390-56de3b2400d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9423f6-b7d5-4c65-a295-e4634b6db5c1', 'volume_name': 'volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c19286-b41d-44b2-8bd4-d9dfb35e42b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c19286-b41d-44b2-8bd4-d9dfb35e42b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ec48e7-1935-41a5-b72b-a6b69a822aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:42 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Volume 5f9423f6-b7d5-4c65-a295-e4634b6db5c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1', 'volume_size': 1} Jun 04 13:27:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:27:43 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Flow 'volume_create_manager' (a8d6251d-dd5e-40f2-89d2-9490646c5abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700adaa7-2f18-48e1-8d2c-aa972c18eab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.992s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:27:43 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Deleted volume successfully. Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700adaa7-2f18-48e1-8d2c-aa972c18eab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768928336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0031bed-7d13-4a26-8dea-fb8e56d8ce86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19829fdd7d6f45888519d00289aeca0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:43Z,use_quota=True,user_id='32a1642e3c504ea8bad7eff40b7605c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878ed51c-b066-4532-945b-5e858b90d16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878ed51c-b066-4532-945b-5e858b90d16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbfa1d9-9ca5-4944-af09-18ea76ba29cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbfa1d9-9ca5-4944-af09-18ea76ba29cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0031bed-7d13-4a26-8dea-fb8e56d8ce86', 'volume_name': 'volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742ac2d2-1898-44d1-9c19-3eca8cbf7824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (742ac2d2-1898-44d1-9c19-3eca8cbf7824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020d1f3e-7def-4700-a480-0952dd6c1c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:43 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Volume c0031bed-7d13-4a26-8dea-fb8e56d8ce86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86', 'volume_size': 1} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6f34ee2c-49ed-4289-ba30-6577c2ab87ee tempest-VolumesNegativeTest-509210944 None] Lock "cinder-855afac6-40d7-45ed-8720-5cdcb352e8d4-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:43 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-182af7ba-1a42-465c-980a-405dd1c7cf9b 1073741824" returned: 0 in 1.311s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-182af7ba-1a42-465c-980a-405dd1c7cf9b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:43 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-182af7ba-1a42-465c-980a-405dd1c7cf9b Jun 04 13:27:43 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Flow 'volume_create_manager' (94edeae2-2796-4636-aea6-c112a7f32f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c06dae8-eb34-41fc-aac2-7a8d1fd8cf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c06dae8-eb34-41fc-aac2-7a8d1fd8cf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-36539427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6915aff-edf6-4c98-a50f-c558ee7ffb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19829fdd7d6f45888519d00289aeca0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:44Z,use_quota=True,user_id='32a1642e3c504ea8bad7eff40b7605c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa7057d-b889-4d9b-a90d-a1571737aadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa7057d-b889-4d9b-a90d-a1571737aadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7f9ce7-9760-437f-8194-1b60b3aee231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7f9ce7-9760-437f-8194-1b60b3aee231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6915aff-edf6-4c98-a50f-c558ee7ffb5d', 'volume_name': 'volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbb42c0-4d5b-47c3-8022-2f221848dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbb42c0-4d5b-47c3-8022-2f221848dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d46a9a-01b6-4068-a697-48430accef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:44 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Volume b6915aff-edf6-4c98-a50f-c558ee7ffb5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d', 'volume_size': 1} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Flow 'volume_create_manager' (e6b86bba-0939-45c4-b809-284ce073df15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb69e4e3-04fc-488f-a966-cf7c55e277cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb69e4e3-04fc-488f-a966-cf7c55e277cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-944764590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efdb090a-fda8-4fce-af57-24b219243576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19829fdd7d6f45888519d00289aeca0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:44Z,use_quota=True,user_id='32a1642e3c504ea8bad7eff40b7605c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fef3674-98ee-4154-835b-16f68c024ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fef3674-98ee-4154-835b-16f68c024ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e295090-ad0c-4ecb-baee-a5eb4a4687ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e295090-ad0c-4ecb-baee-a5eb4a4687ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efdb090a-fda8-4fce-af57-24b219243576', 'volume_name': 'volume-efdb090a-fda8-4fce-af57-24b219243576', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccfd091-24a6-4168-b727-aea1f548cc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccfd091-24a6-4168-b727-aea1f548cc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21631092-26b0-435f-85f7-44c7caa39ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:44 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Volume efdb090a-fda8-4fce-af57-24b219243576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efdb090a-fda8-4fce-af57-24b219243576', 'volume_size': 1} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:44 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-182af7ba-1a42-465c-980a-405dd1c7cf9b" returned: 0 in 0.906s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] <== create_volume: return (2303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.943s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1279018090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9423f6-b7d5-4c65-a295-e4634b6db5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19829fdd7d6f45888519d00289aeca0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:43Z,use_quota=True,user_id='32a1642e3c504ea8bad7eff40b7605c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Creating volume 5f9423f6-b7d5-4c65-a295-e4634b6db5c1 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:27:44 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab91d55-51a5-4f4b-a9fa-62c390f0da3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182af7ba-1a42-465c-980a-405dd1c7cf9b', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:44 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1 1073741824 Jun 04 13:27:44 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de597be4-6aa1-4de5-ba05-4e8b2736c501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:44 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Volume volume-182af7ba-1a42-465c-980a-405dd1c7cf9b (182af7ba-1a42-465c-980a-405dd1c7cf9b): created successfully Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de597be4-6aa1-4de5-ba05-4e8b2736c501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Flow 'volume_create_manager' (88b1cb7e-a514-482a-9050-2b08b2f5e365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:44 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-5141b593-5ea2-431a-a9b1-ff104f733dfa tempest-CreateVolumesFromImageTest-1043020230 None] Created volume successfully. Jun 04 13:27:45 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9" returned: 0 in 2.495s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:45 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b99646ea-dc59-437b-946b-587b029228dd_0qdrbm11devstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:27:45 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Converted 112.00 MB image at 44.86 MB/s Jun 04 13:27:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:45 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 1G Jun 04 13:27:45 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:45 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1 1073741824" returned: 0 in 0.916s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:45 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1 Jun 04 13:27:45 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:45 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 1G" returned: 0 in 0.770s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bb3d3b-a9ea-4258-aff4-89051d54a60f]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:46 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 Jun 04 13:27:46 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:46 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1" returned: 0 in 0.837s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.160s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768928336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0031bed-7d13-4a26-8dea-fb8e56d8ce86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19829fdd7d6f45888519d00289aeca0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:43Z,use_quota=True,user_id='32a1642e3c504ea8bad7eff40b7605c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Creating volume c0031bed-7d13-4a26-8dea-fb8e56d8ce86 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:27:46 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ec48e7-1935-41a5-b72b-a6b69a822aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01493418-46fd-4532-a508-53c079b9aa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:46 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86 1073741824 Jun 04 13:27:46 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:46 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Volume volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1 (5f9423f6-b7d5-4c65-a295-e4634b6db5c1): created successfully Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01493418-46fd-4532-a508-53c079b9aa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Flow 'volume_create_manager' (ababcf7f-652d-4669-ac1a-722131d628be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:46 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8a3514e9-6c13-4492-95a1-3f7c20d61eae tempest-CreateVolumesFromImageTest-1043020230 None] Created volume successfully. Jun 04 13:27:47 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9" returned: 0 in 0.983s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:47 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 Jun 04 13:27:47 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:47 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86 1073741824" returned: 0 in 1.124s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:47 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86 Jun 04 13:27:47 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:47 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9" returned: 1 in 0.825s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Downloaded image b99646ea-dc59-437b-946b-587b029228dd ((None, [{'url': 'file:///opt/stack/data/glance/images/b99646ea-dc59-437b-946b-587b029228dd', 'metadata': {}}])) to volume 673a3b54-95b2-4ad4-b70e-92965b8c1db9 successfully. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Temporary image b99646ea-dc59-437b-946b-587b029228dd for user 48ed3203736b4ab9a51be01b55d2bcec is deleted. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Marking volume 673a3b54-95b2-4ad4-b70e-92965b8c1db9 as bootable. {{(pid=86722) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Copying metadata from image b99646ea-dc59-437b-946b-587b029228dd to 673a3b54-95b2-4ad4-b70e-92965b8c1db9. {{(pid=86722) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Creating volume glance metadata for volume 673a3b54-95b2-4ad4-b70e-92965b8c1db9 backed by image b99646ea-dc59-437b-946b-587b029228dd with: {'image_id': 'b99646ea-dc59-437b-946b-587b029228dd', 'image_name': 'tempest-scenario-img--638072306', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86722) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c001c5aa-fab6-4138-a9b0-ba4b44a9012c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9', 'volume_size': 1, 'image_id': 'b99646ea-dc59-437b-946b-587b029228dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b99646ea-dc59-437b-946b-587b029228dd', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--638072306', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9f41a9b9ec104f069f0b0ebf8eb0efd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b99646ea-dc59-437b-946b-587b029228dd', 'created_at': datetime.datetime(2026, 6, 4, 11, 27, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 27, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b99646ea-dc59-437b-946b-587b029228dd/file', 'properties': {}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65589163-2987-4adf-92eb-ac6a7713b862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:48 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Volume volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 (673a3b54-95b2-4ad4-b70e-92965b8c1db9): created successfully Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65589163-2987-4adf-92eb-ac6a7713b862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Flow 'volume_create_manager' (89857e90-06bd-496e-816e-1a6eecb748f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:48 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a859ac6d-6708-4b74-aea6-0005846ebc73 tempest-TestInstancesWithCinderVolumes-1788480100 None] Created volume successfully. Jun 04 13:27:48 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86" returned: 0 in 0.747s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.438s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-36539427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6915aff-edf6-4c98-a50f-c558ee7ffb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19829fdd7d6f45888519d00289aeca0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:44Z,use_quota=True,user_id='32a1642e3c504ea8bad7eff40b7605c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Creating volume b6915aff-edf6-4c98-a50f-c558ee7ffb5d {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:27:48 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:48 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d 1073741824 Jun 04 13:27:48 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020d1f3e-7def-4700-a480-0952dd6c1c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f2348d-fa02-44ae-991f-459b158ba5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:48 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Volume volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86 (c0031bed-7d13-4a26-8dea-fb8e56d8ce86): created successfully Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f2348d-fa02-44ae-991f-459b158ba5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Flow 'volume_create_manager' (a8d6251d-dd5e-40f2-89d2-9490646c5abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:48 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9a6b70a4-d2ee-4bd0-a2d2-2415560c585f tempest-CreateVolumesFromImageTest-1043020230 None] Created volume successfully. Jun 04 13:27:49 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d 1073741824" returned: 0 in 1.171s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:49 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d Jun 04 13:27:49 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:50 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d" returned: 0 in 0.810s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.134s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-944764590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efdb090a-fda8-4fce-af57-24b219243576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19829fdd7d6f45888519d00289aeca0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:44Z,use_quota=True,user_id='32a1642e3c504ea8bad7eff40b7605c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Creating volume efdb090a-fda8-4fce-af57-24b219243576 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:27:50 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-efdb090a-fda8-4fce-af57-24b219243576 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:50 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-efdb090a-fda8-4fce-af57-24b219243576 1073741824 Jun 04 13:27:50 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d46a9a-01b6-4068-a697-48430accef3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d756fa3e-fd9f-4c47-aec9-049669e1fc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:50 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Volume volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d (b6915aff-edf6-4c98-a50f-c558ee7ffb5d): created successfully Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d756fa3e-fd9f-4c47-aec9-049669e1fc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Flow 'volume_create_manager' (94edeae2-2796-4636-aea6-c112a7f32f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:50 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8bc5fdf7-ee7d-4b13-a6e6-1df0624052ba tempest-CreateVolumesFromImageTest-1043020230 None] Created volume successfully. Jun 04 13:27:51 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-efdb090a-fda8-4fce-af57-24b219243576 1073741824" returned: 0 in 0.983s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-efdb090a-fda8-4fce-af57-24b219243576 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:51 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-efdb090a-fda8-4fce-af57-24b219243576 Jun 04 13:27:51 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:52 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-efdb090a-fda8-4fce-af57-24b219243576" returned: 0 in 0.604s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21631092-26b0-435f-85f7-44c7caa39ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efdb090a-fda8-4fce-af57-24b219243576', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34036c73-300b-47bf-b210-c19d4c1ffc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:52 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Volume volume-efdb090a-fda8-4fce-af57-24b219243576 (efdb090a-fda8-4fce-af57-24b219243576): created successfully Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34036c73-300b-47bf-b210-c19d4c1ffc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Flow 'volume_create_manager' (e6b86bba-0939-45c4-b809-284ce073df15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:52 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-be270e9d-d48c-4b44-bed4-86e9bf258b20 tempest-CreateVolumesFromImageTest-1043020230 None] Created volume successfully. Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Flow 'volume_create_manager' (df65b63f-59f1-4680-a6f1-1125c50d2e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc852e4-fd7c-4c6f-8b79-73972213fbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc852e4-fd7c-4c6f-8b79-73972213fbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1725029090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37dd011-82bd-428e-9dcf-3ced1ce10673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a41550f3ed244e6a00b49a1e55c884b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:53Z,use_quota=True,user_id='34bd751d332c4f66ba1a17b999d7db3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba0de81-e935-4525-83d2-cda5828edd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ba0de81-e935-4525-83d2-cda5828edd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2230f802-eae5-4112-9830-0779adeaced8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2230f802-eae5-4112-9830-0779adeaced8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f37dd011-82bd-428e-9dcf-3ced1ce10673', 'volume_name': 'volume-f37dd011-82bd-428e-9dcf-3ced1ce10673', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5263e31-7339-4ccf-9d8b-49ec287304cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5263e31-7339-4ccf-9d8b-49ec287304cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9a508c-e62a-4d73-8814-e0dc75c84902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:52 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Volume f37dd011-82bd-428e-9dcf-3ced1ce10673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f37dd011-82bd-428e-9dcf-3ced1ce10673', 'volume_size': 1} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1725029090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37dd011-82bd-428e-9dcf-3ced1ce10673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a41550f3ed244e6a00b49a1e55c884b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:27:53Z,use_quota=True,user_id='34bd751d332c4f66ba1a17b999d7db3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Creating volume f37dd011-82bd-428e-9dcf-3ced1ce10673 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:27:52 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:27:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:53 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673 1073741824 Jun 04 13:27:53 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "cinder-efdb090a-fda8-4fce-af57-24b219243576-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-efdb090a-fda8-4fce-af57-24b219243576-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "cinder-quobyte-efdb090a-fda8-4fce-af57-24b219243576" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-quobyte-efdb090a-fda8-4fce-af57-24b219243576" acquired by "delete_volume" :: waited 0.030s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:53 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcfd44d-85c6-4a76-aca6-00915cf9c8b0]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-efdb090a-fda8-4fce-af57-24b219243576 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:53 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-efdb090a-fda8-4fce-af57-24b219243576 Jun 04 13:27:53 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:54 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673 1073741824" returned: 0 in 1.099s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:54 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673 Jun 04 13:27:54 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:54 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-efdb090a-fda8-4fce-af57-24b219243576" returned: 0 in 0.796s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-efdb090a-fda8-4fce-af57-24b219243576 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:54 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-efdb090a-fda8-4fce-af57-24b219243576 Jun 04 13:27:54 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:54 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673" returned: 0 in 0.665s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:27:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9a508c-e62a-4d73-8814-e0dc75c84902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37dd011-82bd-428e-9dcf-3ced1ce10673', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9163458a-5a53-4d9c-9d5b-0aa6aa9e8414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:27:54 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Volume volume-f37dd011-82bd-428e-9dcf-3ced1ce10673 (f37dd011-82bd-428e-9dcf-3ced1ce10673): created successfully Jun 04 13:27:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9163458a-5a53-4d9c-9d5b-0aa6aa9e8414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:27:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Flow 'volume_create_manager' (df65b63f-59f1-4680-a6f1-1125c50d2e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:27:54 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-0a6ef376-3cc3-4c63-ba34-e71013c32d96 tempest-AttachVolumeNegativeTest-351245229 None] Created volume successfully. Jun 04 13:27:55 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-efdb090a-fda8-4fce-af57-24b219243576" returned: 0 in 0.652s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-quobyte-efdb090a-fda8-4fce-af57-24b219243576" released by "delete_volume" :: held 1.526s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Created reservations ['6e2848b5-bdbc-4399-bfbe-bf10eddf58e5', '343dd9ba-0bdd-4b76-a727-6e6e0451ec90', '47997ac1-13c9-42b8-a134-fddcaf7e3ca3', 'baa040d2-0556-461c-b21b-e2264614fe5f'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:55 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:27:55 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "cinder-b6915aff-edf6-4c98-a50f-c558ee7ffb5d-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-b6915aff-edf6-4c98-a50f-c558ee7ffb5d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "cinder-quobyte-b6915aff-edf6-4c98-a50f-c558ee7ffb5d" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-quobyte-b6915aff-edf6-4c98-a50f-c558ee7ffb5d" acquired by "delete_volume" :: waited 0.032s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2478c4-447f-43b5-bbac-b1aa1473a5db]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:55 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.625s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:27:55 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Deleted volume successfully. Jun 04 13:27:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-39ed8d3d-3274-49c8-8a1f-d23e4c99cf85 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-efdb090a-fda8-4fce-af57-24b219243576-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:55 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d Jun 04 13:27:55 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:56 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d" returned: 0 in 0.835s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:56 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d Jun 04 13:27:56 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:57 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b6915aff-edf6-4c98-a50f-c558ee7ffb5d" returned: 0 in 0.845s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-quobyte-b6915aff-edf6-4c98-a50f-c558ee7ffb5d" released by "delete_volume" :: held 1.741s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:57 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Created reservations ['2e7fce8e-a582-4a39-b736-75db51da7971', '43c05ad7-8491-4d23-890d-2bee22978b31', 'f66dff0b-ca00-48f5-8907-8b5abf44d98e', 'a0c5220b-972c-45f2-a229-ca4414965a08'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:27:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:27:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:27:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:27:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:57 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:27:57 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "cinder-c0031bed-7d13-4a26-8dea-fb8e56d8ce86-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-c0031bed-7d13-4a26-8dea-fb8e56d8ce86-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "cinder-quobyte-c0031bed-7d13-4a26-8dea-fb8e56d8ce86" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:27:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-quobyte-c0031bed-7d13-4a26-8dea-fb8e56d8ce86" acquired by "delete_volume" :: waited 0.047s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:27:58 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[2364b560-8224-453e-a43c-0a4c98cec94e]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-8010a465-7cfb-4b5b-bddf-3c282253c86d req-5cdf004e-3a22-4920-9c3f-f20a38bf0211 tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-8010a465-7cfb-4b5b-bddf-3c282253c86d req-5cdf004e-3a22-4920-9c3f-f20a38bf0211 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:27:58 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[75054bd4-cf14-4683-9982-c7960a8f993f]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:27:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-8010a465-7cfb-4b5b-bddf-3c282253c86d req-5cdf004e-3a22-4920-9c3f-f20a38bf0211 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:58 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86 Jun 04 13:27:58 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:58 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 Jun 04 13:27:58 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:58 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.028s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:58 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:27:58 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Deleted volume successfully. Jun 04 13:27:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3646893c-9801-4918-851b-70fe4ac50d86 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-b6915aff-edf6-4c98-a50f-c558ee7ffb5d-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:27:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-10c555e3-7545-4f12-b480-1d38b395a8e6 req-55aabd11-4f5c-4dbd-a05a-349908eb8cb8 tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:27:59 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-8010a465-7cfb-4b5b-bddf-3c282253c86d req-5cdf004e-3a22-4920-9c3f-f20a38bf0211 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9" returned: 0 in 1.099s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-8010a465-7cfb-4b5b-bddf-3c282253c86d req-5cdf004e-3a22-4920-9c3f-f20a38bf0211 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:59 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Jun 04 13:27:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86" returned: 0 in 1.292s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:27:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:27:59 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86 Jun 04 13:27:59 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:27:59 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 Jun 04 13:27:59 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:00 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c0031bed-7d13-4a26-8dea-fb8e56d8ce86" returned: 0 in 0.714s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-quobyte-c0031bed-7d13-4a26-8dea-fb8e56d8ce86" released by "delete_volume" :: held 2.094s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:00 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-8010a465-7cfb-4b5b-bddf-3c282253c86d req-5cdf004e-3a22-4920-9c3f-f20a38bf0211 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9" returned: 1 in 0.828s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-8010a465-7cfb-4b5b-bddf-3c282253c86d req-5cdf004e-3a22-4920-9c3f-f20a38bf0211 tempest-TestInstancesWithCinderVolumes-1788480100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-8010a465-7cfb-4b5b-bddf-3c282253c86d req-5cdf004e-3a22-4920-9c3f-f20a38bf0211 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.034s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-10c555e3-7545-4f12-b480-1d38b395a8e6 req-55aabd11-4f5c-4dbd-a05a-349908eb8cb8 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.517s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5246ccee-470b-449b-be18-7047b1eb3162]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-10c555e3-7545-4f12-b480-1d38b395a8e6 req-55aabd11-4f5c-4dbd-a05a-349908eb8cb8 tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Created reservations ['1790ffeb-e9f7-48c5-8f8b-c3f9127dddf7', '72bc66e1-b699-4093-b6c4-ed776f43cac1', '75b12539-af80-40ac-b9b0-786da52718da', '16ae7754-ad76-436e-b4ac-8668383e66f5'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-8010a465-7cfb-4b5b-bddf-3c282253c86d req-5cdf004e-3a22-4920-9c3f-f20a38bf0211 tempest-TestInstancesWithCinderVolumes-1788480100 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4802f49c-2d00-4c81-82e3-f556799e1c1f', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:28:00 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673 Jun 04 13:28:00 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:00 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-8010a465-7cfb-4b5b-bddf-3c282253c86d req-5cdf004e-3a22-4920-9c3f-f20a38bf0211 tempest-TestInstancesWithCinderVolumes-1788480100 None] attachment_update completed successfully. Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:00 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:00 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "cinder-5f9423f6-b7d5-4c65-a295-e4634b6db5c1-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-5f9423f6-b7d5-4c65-a295-e4634b6db5c1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "cinder-quobyte-5f9423f6-b7d5-4c65-a295-e4634b6db5c1" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-quobyte-5f9423f6-b7d5-4c65-a295-e4634b6db5c1" acquired by "delete_volume" :: waited 0.035s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:01 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[16238411-c138-4a81-8e7e-0e0c78b205c2]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:01 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.716s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:01 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:01 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Deleted volume successfully. Jun 04 13:28:01 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-10c555e3-7545-4f12-b480-1d38b395a8e6 req-55aabd11-4f5c-4dbd-a05a-349908eb8cb8 tempest-AttachVolumeNegativeTest-351245229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673" returned: 0 in 0.959s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-10c555e3-7545-4f12-b480-1d38b395a8e6 req-55aabd11-4f5c-4dbd-a05a-349908eb8cb8 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.993s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:01 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1 Jun 04 13:28:01 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-63289ea7-e824-4cc3-b09d-988d853656ca tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-c0031bed-7d13-4a26-8dea-fb8e56d8ce86-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-10c555e3-7545-4f12-b480-1d38b395a8e6 req-55aabd11-4f5c-4dbd-a05a-349908eb8cb8 tempest-AttachVolumeNegativeTest-351245229 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-f37dd011-82bd-428e-9dcf-3ced1ce10673', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54d83466-4d6b-4aa5-bc41-368576c7ebe6', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:28:01 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-10c555e3-7545-4f12-b480-1d38b395a8e6 req-55aabd11-4f5c-4dbd-a05a-349908eb8cb8 tempest-AttachVolumeNegativeTest-351245229 None] attachment_update completed successfully. Jun 04 13:28:02 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1" returned: 0 in 0.978s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:02 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1 Jun 04 13:28:02 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:02 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5f9423f6-b7d5-4c65-a295-e4634b6db5c1" returned: 0 in 0.678s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:02 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-quobyte-5f9423f6-b7d5-4c65-a295-e4634b6db5c1" released by "delete_volume" :: held 1.721s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:02 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Created reservations ['be32538c-8db5-4ef5-b9c2-dcf8ec9943e1', 'eb33e67f-2a67-45eb-b366-4d3c54b91650', 'f354d221-a681-4f07-bf24-854e42e6109e', 'a489fd3a-d3c3-40af-8c21-8659172e8166'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:02 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:02 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "cinder-182af7ba-1a42-465c-980a-405dd1c7cf9b-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-182af7ba-1a42-465c-980a-405dd1c7cf9b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "cinder-quobyte-182af7ba-1a42-465c-980a-405dd1c7cf9b" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-quobyte-182af7ba-1a42-465c-980a-405dd1c7cf9b" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:03 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73444d4-7de4-4375-b4af-e4c8445eb467]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-182af7ba-1a42-465c-980a-405dd1c7cf9b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:03 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-182af7ba-1a42-465c-980a-405dd1c7cf9b Jun 04 13:28:03 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:03 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.657s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:03 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:03 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Deleted volume successfully. Jun 04 13:28:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d02a16d0-97e7-41ce-95a8-f59877fe0917 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-5f9423f6-b7d5-4c65-a295-e4634b6db5c1-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:04 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:04 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:04 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-182af7ba-1a42-465c-980a-405dd1c7cf9b" returned: 0 in 0.782s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-182af7ba-1a42-465c-980a-405dd1c7cf9b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:04 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-182af7ba-1a42-465c-980a-405dd1c7cf9b Jun 04 13:28:04 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:04 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-182af7ba-1a42-465c-980a-405dd1c7cf9b" returned: 0 in 0.640s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-quobyte-182af7ba-1a42-465c-980a-405dd1c7cf9b" released by "delete_volume" :: held 1.489s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:04 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.742s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Created reservations ['91b457de-0c6c-494b-a950-f3cbf725f3a1', '75550cfc-3ae5-4b56-81af-52aebd294d92', 'f1fdc246-e7e0-413c-be82-38ff83451879', '3de4a15a-18bd-470d-b63a-81b2101e0baf'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:04 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:04 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:05 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.085s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:05 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:05 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Deleted volume successfully. Jun 04 13:28:06 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a040a0bc-be81-45ba-98d8-95e053988f32 tempest-CreateVolumesFromImageTest-1043020230 None] Lock "cinder-182af7ba-1a42-465c-980a-405dd1c7cf9b-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:09 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-8e6ebd5b-1d02-4d5f-bef2-bbaba9f8d91b req-ca10989d-5397-4cd2-b64d-52ce7360a9d6 tempest-AttachVolumeNegativeTest-351245229 None] Terminate volume connection completed successfully. Jun 04 13:28:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-8e6ebd5b-1d02-4d5f-bef2-bbaba9f8d91b req-ca10989d-5397-4cd2-b64d-52ce7360a9d6 tempest-AttachVolumeNegativeTest-351245229 None] Deleting attachment 54d83466-4d6b-4aa5-bc41-368576c7ebe6. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Flow 'volume_create_manager' (f759120f-f391-486d-8656-f772f301d8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2b0a2c-3eb6-460f-beda-9e108637024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2b0a2c-3eb6-460f-beda-9e108637024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1859879356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89ae223-f53d-4e59-8132-5e167496e0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9a909a6604729afb0e497151dbb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:11Z,use_quota=True,user_id='7e7961541976416f9776c7b6d03d46b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e11f8ce-3d9d-4c9e-a988-da447a1547c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e11f8ce-3d9d-4c9e-a988-da447a1547c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17aec12d-4e32-4776-83f5-e9fbabbcb959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17aec12d-4e32-4776-83f5-e9fbabbcb959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89ae223-f53d-4e59-8132-5e167496e0a2', 'volume_name': 'volume-c89ae223-f53d-4e59-8132-5e167496e0a2', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbbf6c5-84ff-45d4-95c1-efe972c637a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbbf6c5-84ff-45d4-95c1-efe972c637a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae96694-c0fb-4281-9c70-87805bcc45dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:11 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume c89ae223-f53d-4e59-8132-5e167496e0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89ae223-f53d-4e59-8132-5e167496e0a2', 'volume_size': 1} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1859879356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89ae223-f53d-4e59-8132-5e167496e0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9a909a6604729afb0e497151dbb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:11Z,use_quota=True,user_id='7e7961541976416f9776c7b6d03d46b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Creating volume c89ae223-f53d-4e59-8132-5e167496e0a2 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:28:11 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:28:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:11 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 1073741824 Jun 04 13:28:11 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:12 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 1073741824" returned: 0 in 1.447s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:13 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 Jun 04 13:28:13 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:14 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2" returned: 0 in 1.529s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] <== create_volume: return (3052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:28:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.055s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:14 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=86,cinder:UPDATE=106,cinder:DELETE=11,cinder:INSERT=28 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:28:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae96694-c0fb-4281-9c70-87805bcc45dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89ae223-f53d-4e59-8132-5e167496e0a2', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef549b39-2f8d-4c4b-8fd8-4d2668f15108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:14 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume volume-c89ae223-f53d-4e59-8132-5e167496e0a2 (c89ae223-f53d-4e59-8132-5e167496e0a2): created successfully Jun 04 13:28:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef549b39-2f8d-4c4b-8fd8-4d2668f15108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Flow 'volume_create_manager' (f759120f-f391-486d-8656-f772f301d8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:14 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-029f4e3a-b9a9-447e-8829-0d086a514e0d tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created volume successfully. Jun 04 13:28:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:16 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] Creating offline snapshot 8ccfb4f9-0c8f-496d-ae5c-745aef860999 of volume c89ae223-f53d-4e59-8132-5e167496e0a2 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:28:16 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2fc341-6645-4561-8b1f-bd8ad9190036]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:16 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 Jun 04 13:28:16 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:17 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2" returned: 0 in 1.241s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:17 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 1G Jun 04 13:28:17 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:18 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 1G" returned: 0 in 1.048s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89ae223-f53d-4e59-8132-5e167496e0a2 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:18 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89ae223-f53d-4e59-8132-5e167496e0a2 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 Jun 04 13:28:18 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:19 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89ae223-f53d-4e59-8132-5e167496e0a2 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999" returned: 0 in 1.087s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:19 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 is being set with open permissions: ugo+rw Jun 04 13:28:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:19 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 Jun 04 13:28:19 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:20 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999" returned: 0 in 0.787s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:20 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.info Jun 04 13:28:20 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:21 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.info" returned: 0 in 0.796s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:21 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.info is being set with open permissions: ugo+rw Jun 04 13:28:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:21 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.info Jun 04 13:28:21 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:21 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.info" returned: 0 in 0.694s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.809s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:22 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e6b8f5ef-10a7-4485-a1aa-16f1a9f33cef tempest-CreateVolumesFromSnapshotTest-1661311981 None] Create snapshot completed successfully Jun 04 13:28:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "cinder-f37dd011-82bd-428e-9dcf-3ced1ce10673-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Lock "cinder-f37dd011-82bd-428e-9dcf-3ced1ce10673-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "cinder-quobyte-f37dd011-82bd-428e-9dcf-3ced1ce10673" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Lock "cinder-quobyte-f37dd011-82bd-428e-9dcf-3ced1ce10673" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:22 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc6a699-e879-42eb-a298-245d759776ca]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:22 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673 Jun 04 13:28:22 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:23 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673" returned: 0 in 0.855s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:28:23 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673 Jun 04 13:28:23 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Flow 'volume_create_manager' (78b780cd-c733-4634-98e4-463e5b476005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7815a323-fbe5-42a1-834f-d2ec676dd6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7815a323-fbe5-42a1-834f-d2ec676dd6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-282111890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6749db3-7085-46b6-a7b7-c257f1de45b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9a909a6604729afb0e497151dbb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:23Z,use_quota=True,user_id='7e7961541976416f9776c7b6d03d46b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b95236-58f0-43b9-92cb-8742519a1d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b95236-58f0-43b9-92cb-8742519a1d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2209478-7a26-4dd0-a4df-9d0131301a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2209478-7a26-4dd0-a4df-9d0131301a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6749db3-7085-46b6-a7b7-c257f1de45b4', 'volume_name': 'volume-d6749db3-7085-46b6-a7b7-c257f1de45b4', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8283449-f3c0-4cd1-a8da-111885e402aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8283449-f3c0-4cd1-a8da-111885e402aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c814bd0e-32ca-44d2-8c68-b1f58d7df30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:23 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume d6749db3-7085-46b6-a7b7-c257f1de45b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6749db3-7085-46b6-a7b7-c257f1de45b4', 'volume_size': 1} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-282111890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6749db3-7085-46b6-a7b7-c257f1de45b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9a909a6604729afb0e497151dbb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:23Z,use_quota=True,user_id='7e7961541976416f9776c7b6d03d46b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Creating volume d6749db3-7085-46b6-a7b7-c257f1de45b4 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:28:23 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d6749db3-7085-46b6-a7b7-c257f1de45b4 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:23 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d6749db3-7085-46b6-a7b7-c257f1de45b4 1073741824 Jun 04 13:28:23 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Flow 'volume_create_manager' (f8fb1d41-28ef-4c38-831a-71fcc51168ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c338344-b85a-4b1c-9b59-917abc11c8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c338344-b85a-4b1c-9b59-917abc11c8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1721839726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2446f20e-c440-49d2-bc3a-8339b3fd5c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9a909a6604729afb0e497151dbb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:24Z,use_quota=True,user_id='7e7961541976416f9776c7b6d03d46b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8710dd3d-f90e-4029-8c2e-730628bb6af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8710dd3d-f90e-4029-8c2e-730628bb6af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2987c313-4e9b-4788-8dd7-57f01317d774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2987c313-4e9b-4788-8dd7-57f01317d774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2446f20e-c440-49d2-bc3a-8339b3fd5c7e', 'volume_name': 'volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed7a382-e774-4931-a237-0937cbaedadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed7a382-e774-4931-a237-0937cbaedadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2252fe2b-b696-4610-bad4-3fe23846e010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:23 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume 2446f20e-c440-49d2-bc3a-8339b3fd5c7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e', 'volume_size': 1} Jun 04 13:28:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Flow 'volume_create_manager' (729f5604-2171-4bb2-90fc-75d275720fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3531a2fe-3151-40cd-b455-33774b9473bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3531a2fe-3151-40cd-b455-33774b9473bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1149806114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=346eb68f-deb8-4509-80a3-eb8b96f66e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9a909a6604729afb0e497151dbb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:24Z,use_quota=True,user_id='7e7961541976416f9776c7b6d03d46b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d146af-8aad-4755-9bbc-4c3dfe1d957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d146af-8aad-4755-9bbc-4c3dfe1d957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:24 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c8fe4b-b918-4e78-93ea-dbc5f4450ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c8fe4b-b918-4e78-93ea-dbc5f4450ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '346eb68f-deb8-4509-80a3-eb8b96f66e42', 'volume_name': 'volume-346eb68f-deb8-4509-80a3-eb8b96f66e42', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a375bd9-73c4-451c-b17e-e725ffc5b2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a375bd9-73c4-451c-b17e-e725ffc5b2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4600a96-f723-48af-89b6-aa7d65978713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:24 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume 346eb68f-deb8-4509-80a3-eb8b96f66e42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-346eb68f-deb8-4509-80a3-eb8b96f66e42', 'volume_size': 1} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-f37dd011-82bd-428e-9dcf-3ced1ce10673" returned: 0 in 1.267s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Lock "cinder-quobyte-f37dd011-82bd-428e-9dcf-3ced1ce10673" released by "delete_volume" :: held 2.170s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Created reservations ['fdf44d61-88da-4135-8a9d-93ff5be3df7f', '1c090ed1-3cb7-4c77-833e-39f0033772bf', '6d382ea5-952d-4d86-8d2f-4e85799e79f8', 'ac19239c-e9f7-4d1a-93f7-68eeaf63a1d3'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=105,cinder:INSERT=33,cinder:UPDATE=120,cinder:DELETE=8 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:24 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:24 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Flow 'volume_create_manager' (ffd60024-d96e-447d-8738-262bbe330981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35bcc63-0f7c-400a-bf4e-4656370065dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35bcc63-0f7c-400a-bf4e-4656370065dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362785494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589084f8-ace0-43dc-be93-fc5c53d42eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9a909a6604729afb0e497151dbb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:25Z,use_quota=True,user_id='7e7961541976416f9776c7b6d03d46b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f60c678-78df-4a2d-b155-6de47b74137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:24 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f60c678-78df-4a2d-b155-6de47b74137d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e230751f-e6fa-459f-af16-71a8112c10f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e230751f-e6fa-459f-af16-71a8112c10f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '589084f8-ace0-43dc-be93-fc5c53d42eaf', 'volume_name': 'volume-589084f8-ace0-43dc-be93-fc5c53d42eaf', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a28a4f0-1842-4128-bebb-f01274d3c150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a28a4f0-1842-4128-bebb-f01274d3c150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8686747-bdbf-445a-b2d2-c70303cb81fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:24 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume 589084f8-ace0-43dc-be93-fc5c53d42eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-589084f8-ace0-43dc-be93-fc5c53d42eaf', 'volume_size': 1} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d6749db3-7085-46b6-a7b7-c257f1de45b4 1073741824" returned: 0 in 1.593s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d6749db3-7085-46b6-a7b7-c257f1de45b4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:25 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d6749db3-7085-46b6-a7b7-c257f1de45b4 Jun 04 13:28:25 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Flow 'volume_create_manager' (045883b4-fbd9-4063-9b02-3808aebf7db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f8614e-2d6a-401c-8b54-80ba652c70af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f8614e-2d6a-401c-8b54-80ba652c70af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-639941531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381aaac3-9e7f-47e7-9a96-fae20a0dda7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9a909a6604729afb0e497151dbb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:25Z,use_quota=True,user_id='7e7961541976416f9776c7b6d03d46b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7b53c4-4897-4aa1-984e-b91098f1b3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7b53c4-4897-4aa1-984e-b91098f1b3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1463972c-303c-480d-a337-16b96941ccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1463972c-303c-480d-a337-16b96941ccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '381aaac3-9e7f-47e7-9a96-fae20a0dda7b', 'volume_name': 'volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:25 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8547fa98-dd4a-4651-bf10-a32d8524b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8547fa98-dd4a-4651-bf10-a32d8524b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e109b3-a589-4178-a549-0c64906cc65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:25 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume 381aaac3-9e7f-47e7-9a96-fae20a0dda7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b', 'volume_size': 1} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.002s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:25 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Deleted volume successfully. Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-585c6ead-287a-401a-a610-8e3fa78e1e33 tempest-AttachVolumeNegativeTest-351245229 None] Lock "cinder-f37dd011-82bd-428e-9dcf-3ced1ce10673-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "cinder-c2f19220-7d00-406b-bf08-b06c42ebb397-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Lock "cinder-c2f19220-7d00-406b-bf08-b06c42ebb397-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "cinder-quobyte-c2f19220-7d00-406b-bf08-b06c42ebb397" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Lock "cinder-quobyte-c2f19220-7d00-406b-bf08-b06c42ebb397" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baf7655-8a68-4607-8245-1332709be32a]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:26 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d6749db3-7085-46b6-a7b7-c257f1de45b4" returned: 0 in 1.032s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] <== create_volume: return (2730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.750s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1721839726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2446f20e-c440-49d2-bc3a-8339b3fd5c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9a909a6604729afb0e497151dbb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:24Z,use_quota=True,user_id='7e7961541976416f9776c7b6d03d46b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Creating volume 2446f20e-c440-49d2-bc3a-8339b3fd5c7e {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:28:26 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c814bd0e-32ca-44d2-8c68-b1f58d7df30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6749db3-7085-46b6-a7b7-c257f1de45b4', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a6302ac-87bd-4651-9976-5d18c77c6f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:26 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e 1073741824 Jun 04 13:28:26 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:26 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume volume-d6749db3-7085-46b6-a7b7-c257f1de45b4 (d6749db3-7085-46b6-a7b7-c257f1de45b4): created successfully Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a6302ac-87bd-4651-9976-5d18c77c6f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:26 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397 Jun 04 13:28:26 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Flow 'volume_create_manager' (78b780cd-c733-4634-98e4-463e5b476005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:26 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-338c6a3b-b904-488a-b0a8-fbbabaa12a55 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created volume successfully. Jun 04 13:28:27 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397" returned: 0 in 1.139s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:27 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397 Jun 04 13:28:27 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:27 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e 1073741824" returned: 0 in 1.181s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:27 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e Jun 04 13:28:27 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:28 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c2f19220-7d00-406b-bf08-b06c42ebb397" returned: 0 in 0.894s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Lock "cinder-quobyte-c2f19220-7d00-406b-bf08-b06c42ebb397" released by "delete_volume" :: held 2.122s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:28 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e" returned: 0 in 0.715s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.690s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1149806114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=346eb68f-deb8-4509-80a3-eb8b96f66e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9a909a6604729afb0e497151dbb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:24Z,use_quota=True,user_id='7e7961541976416f9776c7b6d03d46b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Creating volume 346eb68f-deb8-4509-80a3-eb8b96f66e42 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:28:28 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-346eb68f-deb8-4509-80a3-eb8b96f66e42 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2252fe2b-b696-4610-bad4-3fe23846e010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:28 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-346eb68f-deb8-4509-80a3-eb8b96f66e42 1073741824 Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858bdab6-86c4-4676-858e-93a4aa1a1ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:28 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:28 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e (2446f20e-c440-49d2-bc3a-8339b3fd5c7e): created successfully Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858bdab6-86c4-4676-858e-93a4aa1a1ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Flow 'volume_create_manager' (f8fb1d41-28ef-4c38-831a-71fcc51168ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:28 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-62baa3cf-86bb-4fd0-8b36-d432e6c39fa2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created volume successfully. Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Created reservations ['78be60ac-4842-4e3c-a7b9-481ce98ad32f', '095951ae-9d1b-4098-9ade-13711833137f', 'a8728168-7e57-4a7c-9f55-5e75901aa98f', 'b8b57473-f973-4ae1-b1f9-3bcdaec87358'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:28 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:28 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:28 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-346eb68f-deb8-4509-80a3-eb8b96f66e42 1073741824" returned: 0 in 0.871s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:28 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.715s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:28 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Deleted volume successfully. Jun 04 13:28:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-346eb68f-deb8-4509-80a3-eb8b96f66e42 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:28 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-346eb68f-deb8-4509-80a3-eb8b96f66e42 Jun 04 13:28:28 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a6f094a7-2b9d-45be-ae02-41b27c1528e8 tempest-AttachVolumeNegativeTest-351245229 None] Lock "cinder-c2f19220-7d00-406b-bf08-b06c42ebb397-delete_volume" released by "delete_volume" :: held 3.183s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "cinder-e927234c-6d29-443b-9b00-0f845369ccfa-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Lock "cinder-e927234c-6d29-443b-9b00-0f845369ccfa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "cinder-quobyte-e927234c-6d29-443b-9b00-0f845369ccfa" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Lock "cinder-quobyte-e927234c-6d29-443b-9b00-0f845369ccfa" acquired by "delete_volume" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62f16da-6172-4c0b-b50a-b5fc42b5b003]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:29 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-346eb68f-deb8-4509-80a3-eb8b96f66e42" returned: 0 in 0.650s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.693s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-362785494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589084f8-ace0-43dc-be93-fc5c53d42eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9a909a6604729afb0e497151dbb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:25Z,use_quota=True,user_id='7e7961541976416f9776c7b6d03d46b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Creating volume 589084f8-ace0-43dc-be93-fc5c53d42eaf {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:28:29 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-589084f8-ace0-43dc-be93-fc5c53d42eaf 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:29 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa Jun 04 13:28:29 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:29 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-589084f8-ace0-43dc-be93-fc5c53d42eaf 1073741824 Jun 04 13:28:29 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4600a96-f723-48af-89b6-aa7d65978713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-346eb68f-deb8-4509-80a3-eb8b96f66e42', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d76f9a-bee1-4f89-ad0e-70ce2e769f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:29 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume volume-346eb68f-deb8-4509-80a3-eb8b96f66e42 (346eb68f-deb8-4509-80a3-eb8b96f66e42): created successfully Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d76f9a-bee1-4f89-ad0e-70ce2e769f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Flow 'volume_create_manager' (729f5604-2171-4bb2-90fc-75d275720fdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:29 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-462f38e1-50be-4be0-b7b3-e670a4ae804e tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created volume successfully. Jun 04 13:28:30 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa" returned: 0 in 0.778s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:30 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa Jun 04 13:28:30 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:30 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-589084f8-ace0-43dc-be93-fc5c53d42eaf 1073741824" returned: 0 in 0.898s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-589084f8-ace0-43dc-be93-fc5c53d42eaf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:30 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-589084f8-ace0-43dc-be93-fc5c53d42eaf Jun 04 13:28:30 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:30 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e927234c-6d29-443b-9b00-0f845369ccfa" returned: 0 in 0.632s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:30 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Lock "cinder-quobyte-e927234c-6d29-443b-9b00-0f845369ccfa" released by "delete_volume" :: held 1.461s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Created reservations ['930568be-84e1-40cc-8693-21ca34883dfe', '4453fae2-3292-49b6-8799-6d4e2b44b51a', 'ce1badfa-2497-4846-bab3-201f7c8f48c4', 'ba25648a-126d-430c-b187-f6e4d2df1c3a'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:31 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:31 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:31 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-589084f8-ace0-43dc-be93-fc5c53d42eaf" returned: 0 in 0.651s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.641s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-639941531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381aaac3-9e7f-47e7-9a96-fae20a0dda7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8db9a909a6604729afb0e497151dbb6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:25Z,use_quota=True,user_id='7e7961541976416f9776c7b6d03d46b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Creating volume 381aaac3-9e7f-47e7-9a96-fae20a0dda7b {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:28:31 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8686747-bdbf-445a-b2d2-c70303cb81fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589084f8-ace0-43dc-be93-fc5c53d42eaf', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cc5bf0-60cb-48cb-8c4e-7fd0857ac53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:31 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b 1073741824 Jun 04 13:28:31 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:31 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume volume-589084f8-ace0-43dc-be93-fc5c53d42eaf (589084f8-ace0-43dc-be93-fc5c53d42eaf): created successfully Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cc5bf0-60cb-48cb-8c4e-7fd0857ac53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Flow 'volume_create_manager' (ffd60024-d96e-447d-8738-262bbe330981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:31 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-35aa9019-fec2-469b-9d1b-93db6426ea8f tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created volume successfully. Jun 04 13:28:31 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.638s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:31 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Deleted volume successfully. Jun 04 13:28:31 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e033dc4d-ed74-4f53-b11b-3862f8360d1c tempest-AttachVolumeNegativeTest-351245229 None] Lock "cinder-e927234c-6d29-443b-9b00-0f845369ccfa-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:32 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b 1073741824" returned: 0 in 0.835s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:32 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b Jun 04 13:28:32 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:33 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b" returned: 0 in 0.944s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e109b3-a589-4178-a549-0c64906cc65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc52f337-96b8-4fc9-88d3-a50625dab8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:33 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Volume volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b (381aaac3-9e7f-47e7-9a96-fae20a0dda7b): created successfully Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc52f337-96b8-4fc9-88d3-a50625dab8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Flow 'volume_create_manager' (045883b4-fbd9-4063-9b02-3808aebf7db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:33 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9fb0f98e-daeb-420b-9a43-5d9d84673e5c tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created volume successfully. Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-381aaac3-9e7f-47e7-9a96-fae20a0dda7b-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-381aaac3-9e7f-47e7-9a96-fae20a0dda7b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-quobyte-381aaac3-9e7f-47e7-9a96-fae20a0dda7b" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-381aaac3-9e7f-47e7-9a96-fae20a0dda7b" acquired by "delete_volume" :: waited 0.032s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf48a8a3-826b-4297-9966-6d3c0a726200]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:34 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b Jun 04 13:28:34 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:34 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b" returned: 0 in 1.080s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:34 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b Jun 04 13:28:34 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:35 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-381aaac3-9e7f-47e7-9a96-fae20a0dda7b" returned: 0 in 0.975s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-381aaac3-9e7f-47e7-9a96-fae20a0dda7b" released by "delete_volume" :: held 2.199s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:35 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created reservations ['3c859cc9-3c38-473b-99bd-6168e2dce1d0', '9dd5c615-ea7d-4e57-a6f1-1bf8988db2b9', 'b3b2763b-5b6d-4755-9933-f615efffd764', 'fda58e6c-b11f-4ac6-95ac-f8b3b6616871'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:36 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:36 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:37 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.932s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:37 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:37 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Deleted volume successfully. Jun 04 13:28:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-98e63789-afe4-4b5a-95e2-86ca126e1ac2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-381aaac3-9e7f-47e7-9a96-fae20a0dda7b-delete_volume" released by "delete_volume" :: held 3.545s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-589084f8-ace0-43dc-be93-fc5c53d42eaf-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-589084f8-ace0-43dc-be93-fc5c53d42eaf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-quobyte-589084f8-ace0-43dc-be93-fc5c53d42eaf" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-589084f8-ace0-43dc-be93-fc5c53d42eaf" acquired by "delete_volume" :: waited 0.024s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e550b13-a677-4a7c-af6a-cb0f490b67cc]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-589084f8-ace0-43dc-be93-fc5c53d42eaf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:37 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-589084f8-ace0-43dc-be93-fc5c53d42eaf Jun 04 13:28:37 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Flow 'volume_create_manager' (cc39c6b3-07e7-4c32-9d97-2a53e18cf6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91bd9908-9a03-4bfb-9125-7d7eb1cffc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91bd9908-9a03-4bfb-9125-7d7eb1cffc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-813315122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917292c1-b5a9-4c5f-a65e-bd33423772de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed6ddb946a54dbba41d2334320ccd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:38Z,use_quota=True,user_id='eadb47cf7b114b6b826085e53f55f122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ceca22-a1dc-425b-96f3-64a913e9e3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4ceca22-a1dc-425b-96f3-64a913e9e3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abe0225-e61b-42bb-b4a1-30818ec737a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5abe0225-e61b-42bb-b4a1-30818ec737a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '917292c1-b5a9-4c5f-a65e-bd33423772de', 'volume_name': 'volume-917292c1-b5a9-4c5f-a65e-bd33423772de', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf21b3d1-ba89-41fd-80b5-55bc87487908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf21b3d1-ba89-41fd-80b5-55bc87487908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d86a9266-7ddc-421f-9772-d20459ae7345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:38 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Volume 917292c1-b5a9-4c5f-a65e-bd33423772de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-917292c1-b5a9-4c5f-a65e-bd33423772de', 'volume_size': 1} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-813315122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917292c1-b5a9-4c5f-a65e-bd33423772de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed6ddb946a54dbba41d2334320ccd65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:38Z,use_quota=True,user_id='eadb47cf7b114b6b826085e53f55f122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Creating volume 917292c1-b5a9-4c5f-a65e-bd33423772de {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:28:38 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:38 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de 1073741824 Jun 04 13:28:38 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:38 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-589084f8-ace0-43dc-be93-fc5c53d42eaf" returned: 0 in 1.379s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-589084f8-ace0-43dc-be93-fc5c53d42eaf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:38 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-589084f8-ace0-43dc-be93-fc5c53d42eaf Jun 04 13:28:38 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:39 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-589084f8-ace0-43dc-be93-fc5c53d42eaf" returned: 0 in 0.857s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-589084f8-ace0-43dc-be93-fc5c53d42eaf" released by "delete_volume" :: held 2.317s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:39 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created reservations ['2e7762f3-15d8-47a1-a3ab-dd77a4b2b2d4', '0a79c913-3968-44a0-b183-6fbdd729344e', '9d247064-c443-407e-8cf4-bdf6741e3267', '2f2e0e9b-8729-4dab-9d4d-ab16f4b6d782'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:39 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de 1073741824" returned: 0 in 1.150s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:39 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de Jun 04 13:28:39 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:39 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:39 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-346eb68f-deb8-4509-80a3-eb8b96f66e42-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-346eb68f-deb8-4509-80a3-eb8b96f66e42-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:40 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-quobyte-346eb68f-deb8-4509-80a3-eb8b96f66e42" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de" returned: 0 in 1.014s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-346eb68f-deb8-4509-80a3-eb8b96f66e42" acquired by "delete_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d86a9266-7ddc-421f-9772-d20459ae7345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917292c1-b5a9-4c5f-a65e-bd33423772de', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760eb6c0-4889-40fb-86f2-57af3575909d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbc4a0c-9dfb-46d6-a3af-e55e7290663b]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-346eb68f-deb8-4509-80a3-eb8b96f66e42 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:40 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Volume volume-917292c1-b5a9-4c5f-a65e-bd33423772de (917292c1-b5a9-4c5f-a65e-bd33423772de): created successfully Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760eb6c0-4889-40fb-86f2-57af3575909d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Flow 'volume_create_manager' (cc39c6b3-07e7-4c32-9d97-2a53e18cf6b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:40 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.102s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:40 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Deleted volume successfully. Jun 04 13:28:40 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fccde973-e41e-416c-94b9-e69c40c2d114 tempest-TestMinimumBasicScenario-1180715691 None] Created volume successfully. Jun 04 13:28:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-e8f2d99d-0891-4594-bc79-53b34a2697ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-589084f8-ace0-43dc-be93-fc5c53d42eaf-delete_volume" released by "delete_volume" :: held 3.793s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:40 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-346eb68f-deb8-4509-80a3-eb8b96f66e42 Jun 04 13:28:40 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:41 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-346eb68f-deb8-4509-80a3-eb8b96f66e42" returned: 0 in 0.813s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-346eb68f-deb8-4509-80a3-eb8b96f66e42 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:41 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-346eb68f-deb8-4509-80a3-eb8b96f66e42 Jun 04 13:28:41 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:42 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-346eb68f-deb8-4509-80a3-eb8b96f66e42" returned: 0 in 0.680s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-346eb68f-deb8-4509-80a3-eb8b96f66e42" released by "delete_volume" :: held 1.558s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created reservations ['919af57d-dcfe-45bd-9a95-f96ebb83eee3', '6d8770a8-33b1-412c-8fb7-4c4ccdef57b6', '232b898e-6738-4e0c-bfed-bc64210111f7', '98ef8547-9620-4136-a201-27e5605c3d62'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Flow 'volume_create_manager' (54082209-12b7-4e8f-9506-c0483f26633a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766c2930-3638-46bb-8599-8de71d8d926d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766c2930-3638-46bb-8599-8de71d8d926d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-365923211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a00f23dc8ebe4b42832a37416f1f3d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:42Z,use_quota=True,user_id='62dd7a98386b403a8ab60ec6a51b52b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5497cd5b-a75b-4d7c-b689-ab2652841308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5497cd5b-a75b-4d7c-b689-ab2652841308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:42 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049f27b9-533c-4d95-b6c6-50fd50e4b08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:42 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049f27b9-533c-4d95-b6c6-50fd50e4b08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc', 'volume_name': 'volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70027e2-1cbb-4daa-9cb8-67346e73e91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c70027e2-1cbb-4daa-9cb8-67346e73e91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e99f90-82c0-4ec2-a51c-332c76f363af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:42 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Volume 2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc', 'volume_size': 1} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-365923211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a00f23dc8ebe4b42832a37416f1f3d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:42Z,use_quota=True,user_id='62dd7a98386b403a8ab60ec6a51b52b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Creating volume 2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:28:42 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:28:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:42 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc 1073741824 Jun 04 13:28:42 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-2446f20e-c440-49d2-bc3a-8339b3fd5c7e-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-2446f20e-c440-49d2-bc3a-8339b3fd5c7e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-quobyte-2446f20e-c440-49d2-bc3a-8339b3fd5c7e" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-2446f20e-c440-49d2-bc3a-8339b3fd5c7e" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:43 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[4605947c-16e8-4f5d-80a5-66c2e565aa76]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:43 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e Jun 04 13:28:43 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:43 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.003s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:43 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:43 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Deleted volume successfully. Jun 04 13:28:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f09ca63d-167e-4b40-a0ed-d7b5fa99d884 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-346eb68f-deb8-4509-80a3-eb8b96f66e42-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-0eaa8a87-caf2-40c7-b717-001043797777 req-b108276a-39f0-4fb0-bcde-3e66e9182d12 tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:43 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc 1073741824" returned: 0 in 1.159s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:43 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc Jun 04 13:28:43 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:44 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e" returned: 0 in 0.949s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:44 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e Jun 04 13:28:44 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:44 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc" returned: 0 in 0.776s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-0eaa8a87-caf2-40c7-b717-001043797777 req-b108276a-39f0-4fb0-bcde-3e66e9182d12 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.921s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e99f90-82c0-4ec2-a51c-332c76f363af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3c48f6-2c18-4c1d-aa97-798ba6c2639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8a106d-4766-46ec-8147-1fd1fea788fd]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-0eaa8a87-caf2-40c7-b717-001043797777 req-b108276a-39f0-4fb0-bcde-3e66e9182d12 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:44 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Volume volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc (2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc): created successfully Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3c48f6-2c18-4c1d-aa97-798ba6c2639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Flow 'volume_create_manager' (54082209-12b7-4e8f-9506-c0483f26633a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:44 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6537588c-a03a-4338-b132-aaa178eb7669 tempest-VolumesTestJSON-522030359 None] Created volume successfully. Jun 04 13:28:44 devstack sudo[99098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246 Jun 04 13:28:44 devstack sudo[99098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-0c3ba726-4d62-4560-b2de-641d27afabba req-6ac968da-bad7-4d21-b91a-93031055fdb8 tempest-TestMinimumBasicScenario-1180715691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:45 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2446f20e-c440-49d2-bc3a-8339b3fd5c7e" returned: 0 in 0.828s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-2446f20e-c440-49d2-bc3a-8339b3fd5c7e" released by "delete_volume" :: held 1.846s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created reservations ['211bcc35-aa5b-41d7-ad6e-323e6c83b2be', '4c654b01-9108-44ba-bbe6-7f96a54a7e02', '216dcdb1-ee13-4e09-b823-81ca8070971a', '84f1eb2d-544f-4fb5-bf31-3d019be1a508'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:45 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:45 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:45 devstack sudo[99098]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-0eaa8a87-caf2-40c7-b717-001043797777 req-b108276a-39f0-4fb0-bcde-3e66e9182d12 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246" returned: 0 in 0.783s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-0eaa8a87-caf2-40c7-b717-001043797777 req-b108276a-39f0-4fb0-bcde-3e66e9182d12 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.823s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-0c3ba726-4d62-4560-b2de-641d27afabba req-6ac968da-bad7-4d21-b91a-93031055fdb8 tempest-TestMinimumBasicScenario-1180715691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.452s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99e66aa-741f-4121-9f6d-80bb2c325365]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-0c3ba726-4d62-4560-b2de-641d27afabba req-6ac968da-bad7-4d21-b91a-93031055fdb8 tempest-TestMinimumBasicScenario-1180715691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-0eaa8a87-caf2-40c7-b717-001043797777 req-b108276a-39f0-4fb0-bcde-3e66e9182d12 tempest-TestInstancesWithCinderVolumes-1788480100 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b139f46-1c25-4827-964d-f7fcb7665e90', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:28:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-0eaa8a87-caf2-40c7-b717-001043797777 req-b108276a-39f0-4fb0-bcde-3e66e9182d12 tempest-TestInstancesWithCinderVolumes-1788480100 None] attachment_update completed successfully. Jun 04 13:28:45 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de Jun 04 13:28:45 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:45 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.691s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Deleted volume successfully. Jun 04 13:28:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-77cc8125-166b-49ce-adc9-e2558569fdd2 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-2446f20e-c440-49d2-bc3a-8339b3fd5c7e-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-d6749db3-7085-46b6-a7b7-c257f1de45b4-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-d6749db3-7085-46b6-a7b7-c257f1de45b4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-quobyte-d6749db3-7085-46b6-a7b7-c257f1de45b4" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-d6749db3-7085-46b6-a7b7-c257f1de45b4" acquired by "delete_volume" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6848ce-bd68-46ed-8b4e-fff1dad14f7f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d6749db3-7085-46b6-a7b7-c257f1de45b4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:46 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d6749db3-7085-46b6-a7b7-c257f1de45b4 Jun 04 13:28:46 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:46 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-0c3ba726-4d62-4560-b2de-641d27afabba req-6ac968da-bad7-4d21-b91a-93031055fdb8 tempest-TestMinimumBasicScenario-1180715691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de" returned: 0 in 0.936s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-0c3ba726-4d62-4560-b2de-641d27afabba req-6ac968da-bad7-4d21-b91a-93031055fdb8 tempest-TestMinimumBasicScenario-1180715691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.962s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-0c3ba726-4d62-4560-b2de-641d27afabba req-6ac968da-bad7-4d21-b91a-93031055fdb8 tempest-TestMinimumBasicScenario-1180715691 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-917292c1-b5a9-4c5f-a65e-bd33423772de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67ad3f15-fa4a-4403-8625-79df038fb001', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:28:46 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-0c3ba726-4d62-4560-b2de-641d27afabba req-6ac968da-bad7-4d21-b91a-93031055fdb8 tempest-TestMinimumBasicScenario-1180715691 None] attachment_update completed successfully. Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Flow 'volume_create_manager' (fd7b4b64-01e7-4032-b949-6373e5e83398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8d78e5-7f0f-4309-bc65-c013e08bde27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8d78e5-7f0f-4309-bc65-c013e08bde27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1683107873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7aaf98-5569-4b67-b73e-59f621880c66,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a00f23dc8ebe4b42832a37416f1f3d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:47Z,use_quota=True,user_id='62dd7a98386b403a8ab60ec6a51b52b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4c8a04-138f-4d92-a1f6-e3f82aab7aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f4c8a04-138f-4d92-a1f6-e3f82aab7aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ba70aa-cda4-4318-a236-86ab054ae506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ba70aa-cda4-4318-a236-86ab054ae506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a7aaf98-5569-4b67-b73e-59f621880c66', 'volume_name': 'volume-5a7aaf98-5569-4b67-b73e-59f621880c66', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d88dec6-804b-445a-9e0c-6f738bef37b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d88dec6-804b-445a-9e0c-6f738bef37b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185f4a2e-ae36-4b28-abf9-c52a2d58edd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:46 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Volume 5a7aaf98-5569-4b67-b73e-59f621880c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a7aaf98-5569-4b67-b73e-59f621880c66', 'volume_size': 1} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1683107873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7aaf98-5569-4b67-b73e-59f621880c66,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a00f23dc8ebe4b42832a37416f1f3d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:47Z,use_quota=True,user_id='62dd7a98386b403a8ab60ec6a51b52b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Creating volume 5a7aaf98-5569-4b67-b73e-59f621880c66 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:28:46 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:28:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5a7aaf98-5569-4b67-b73e-59f621880c66 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:46 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5a7aaf98-5569-4b67-b73e-59f621880c66 1073741824 Jun 04 13:28:46 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:47 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d6749db3-7085-46b6-a7b7-c257f1de45b4" returned: 0 in 1.068s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d6749db3-7085-46b6-a7b7-c257f1de45b4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:47 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d6749db3-7085-46b6-a7b7-c257f1de45b4 Jun 04 13:28:47 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:47 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5a7aaf98-5569-4b67-b73e-59f621880c66 1073741824" returned: 0 in 0.957s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5a7aaf98-5569-4b67-b73e-59f621880c66 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:47 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5a7aaf98-5569-4b67-b73e-59f621880c66 Jun 04 13:28:47 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:47 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d6749db3-7085-46b6-a7b7-c257f1de45b4" returned: 0 in 0.719s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-d6749db3-7085-46b6-a7b7-c257f1de45b4" released by "delete_volume" :: held 1.845s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created reservations ['2e133133-8370-482f-9240-40ee6bed2df4', '3d66b4c5-e125-4486-87d7-d6fbc90d9d4d', '732b4861-9b90-4c85-9bd6-96578046729e', 'd8f1d6e7-71af-47f2-9e79-4ff6d7b4ca65'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:48 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:48 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-8ccfb4f9-0c8f-496d-ae5c-745aef860999-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-8ccfb4f9-0c8f-496d-ae5c-745aef860999-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-quobyte-c89ae223-f53d-4e59-8132-5e167496e0a2" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-c89ae223-f53d-4e59-8132-5e167496e0a2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-quobyte-8ccfb4f9-0c8f-496d-ae5c-745aef860999" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-8ccfb4f9-0c8f-496d-ae5c-745aef860999" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Deleting offline snapshot 8ccfb4f9-0c8f-496d-ae5c-745aef860999 of volume c89ae223-f53d-4e59-8132-5e167496e0a2 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] snapshot_file for this snap is: volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ade4ae3-d22a-4bb9-93cb-da3ab6a401e6]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:48 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5a7aaf98-5569-4b67-b73e-59f621880c66" returned: 0 in 0.652s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185f4a2e-ae36-4b28-abf9-c52a2d58edd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7aaf98-5569-4b67-b73e-59f621880c66', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42de9d9b-e6d3-4a82-ac4c-51679d23ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:48 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Volume volume-5a7aaf98-5569-4b67-b73e-59f621880c66 (5a7aaf98-5569-4b67-b73e-59f621880c66): created successfully Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42de9d9b-e6d3-4a82-ac4c-51679d23ca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Flow 'volume_create_manager' (fd7b4b64-01e7-4032-b949-6373e5e83398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:48 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ad128dd1-dda9-4f81-b197-8d9fdfa52053 tempest-VolumesTestJSON-522030359 None] Created volume successfully. Jun 04 13:28:48 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 Jun 04 13:28:48 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:48 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.659s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:48 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Deleted volume successfully. Jun 04 13:28:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0b7a5335-4d1b-4a65-b798-a538c95482ff tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-d6749db3-7085-46b6-a7b7-c257f1de45b4-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:49 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999" returned: 0 in 0.782s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c89ae223-f53d-4e59-8132-5e167496e0a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dfb6b1-bac8-4a8c-ad4c-8ee058566ca5]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Flow 'volume_create_manager' (387fb18b-b776-417c-b805-1ff98306665e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287aa870-8e67-415a-9062-10187376c031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287aa870-8e67-415a-9062-10187376c031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-337855261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1422b0ed-4d07-45f3-8ea7-627e77c614f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a00f23dc8ebe4b42832a37416f1f3d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:49Z,use_quota=True,user_id='62dd7a98386b403a8ab60ec6a51b52b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:49 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 Jun 04 13:28:49 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f12e54-2aa3-411e-8968-525901bc4eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f12e54-2aa3-411e-8968-525901bc4eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c60f1fe-951c-43b4-bb4c-54d28a827937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c60f1fe-951c-43b4-bb4c-54d28a827937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1422b0ed-4d07-45f3-8ea7-627e77c614f1', 'volume_name': 'volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68e3c9f-c62d-4f9e-9e76-9efcffe489be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68e3c9f-c62d-4f9e-9e76-9efcffe489be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa526fb-f06e-4ca6-ade2-5971de66c41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:49 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Volume 1422b0ed-4d07-45f3-8ea7-627e77c614f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1', 'volume_size': 1} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-337855261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1422b0ed-4d07-45f3-8ea7-627e77c614f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a00f23dc8ebe4b42832a37416f1f3d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:28:49Z,use_quota=True,user_id='62dd7a98386b403a8ab60ec6a51b52b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Creating volume 1422b0ed-4d07-45f3-8ea7-627e77c614f1 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:28:49 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:28:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:49 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1 1073741824 Jun 04 13:28:49 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:50 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2" returned: 0 in 0.815s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:50 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 Jun 04 13:28:50 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:50 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1 1073741824" returned: 0 in 0.972s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:50 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1 Jun 04 13:28:50 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:50 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999" returned: 0 in 0.791s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:50 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999 Jun 04 13:28:50 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:51 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1" returned: 0 in 0.616s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:28:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa526fb-f06e-4ca6-ade2-5971de66c41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04520f9c-403d-4394-b042-e7a5812d23af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:28:51 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Volume volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1 (1422b0ed-4d07-45f3-8ea7-627e77c614f1): created successfully Jun 04 13:28:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04520f9c-403d-4394-b042-e7a5812d23af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:28:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Flow 'volume_create_manager' (387fb18b-b776-417c-b805-1ff98306665e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:28:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b2a7954c-59ab-4ea9-a2e2-1ad0b5c1a6c2 tempest-VolumesTestJSON-522030359 None] Created volume successfully. Jun 04 13:28:51 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2.8ccfb4f9-0c8f-496d-ae5c-745aef860999" returned: 0 in 0.692s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-8ccfb4f9-0c8f-496d-ae5c-745aef860999" released by "_delete_snapshot" :: held 3.231s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-c89ae223-f53d-4e59-8132-5e167496e0a2" released by "delete_snapshot" :: held 3.261s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:51 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created reservations ['96011894-d3ae-4181-adbd-c77d10af93b4', '58f81878-c773-4ec1-ad32-89072af4aff0', '99a7339d-a8f4-42a6-9c5e-2972da7ab2e4', 'dd809dd0-7686-4b45-9e72-d8b2d67c9475'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Delete snapshot completed successfully. Jun 04 13:28:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-954bfa86-ed59-436c-a291-2a3739f0e8a8 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-8ccfb4f9-0c8f-496d-ae5c-745aef860999-delete_snapshot" released by "delete_snapshot" :: held 3.411s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-c89ae223-f53d-4e59-8132-5e167496e0a2-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Acquiring lock "cinder-1422b0ed-4d07-45f3-8ea7-627e77c614f1-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-c89ae223-f53d-4e59-8132-5e167496e0a2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Lock "cinder-1422b0ed-4d07-45f3-8ea7-627e77c614f1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "cinder-quobyte-c89ae223-f53d-4e59-8132-5e167496e0a2" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-c89ae223-f53d-4e59-8132-5e167496e0a2" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Acquiring lock "cinder-quobyte-1422b0ed-4d07-45f3-8ea7-627e77c614f1" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:52 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c32b501-9098-4442-a742-89b9b6e0546b]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Lock "cinder-quobyte-1422b0ed-4d07-45f3-8ea7-627e77c614f1" acquired by "delete_volume" :: waited 0.043s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:52 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb83226d-5ccc-4671-8c6f-e6489d22a78c]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:52 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 Jun 04 13:28:52 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:53 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1 Jun 04 13:28:53 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:53 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2" returned: 0 in 1.024s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:53 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2 Jun 04 13:28:53 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:53 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1" returned: 0 in 1.062s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-863beedb-671e-4ac4-9312-7f23e460e96c req-79f15ad3-4252-4f9c-8de1-ccca837ec1f6 tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-863beedb-671e-4ac4-9312-7f23e460e96c req-79f15ad3-4252-4f9c-8de1-ccca837ec1f6 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:53 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1 Jun 04 13:28:53 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:54 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aeb3fe-c9eb-4020-8895-cc68a2c33f8b]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-863beedb-671e-4ac4-9312-7f23e460e96c req-79f15ad3-4252-4f9c-8de1-ccca837ec1f6 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:54 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1 Jun 04 13:28:54 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:54 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c89ae223-f53d-4e59-8132-5e167496e0a2" returned: 0 in 0.963s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-quobyte-c89ae223-f53d-4e59-8132-5e167496e0a2" released by "delete_volume" :: held 2.089s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:54 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Created reservations ['d8e396a7-d3ca-4903-b807-58698f4db7ed', 'b361b447-7372-4a3f-8bfa-e86f997d8255', 'd9eabe7d-852c-4514-9c90-976c95cc6ec5', 'f53a51ff-c06e-4f34-9258-e44f8a12b2a4'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:55 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1422b0ed-4d07-45f3-8ea7-627e77c614f1" returned: 0 in 1.101s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Lock "cinder-quobyte-1422b0ed-4d07-45f3-8ea7-627e77c614f1" released by "delete_volume" :: held 2.275s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:55 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:55 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Created reservations ['66d00889-0b84-437d-a452-3eb254c0bfcb', '05ec3d59-1b6a-4bfd-bd06-4ed7cbd82391', 'f67c432f-b480-4826-9608-3b1ad17ff004', 'bb8c6f6a-5a2e-4568-92cc-aac3cc905ff8'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:55 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-863beedb-671e-4ac4-9312-7f23e460e96c req-79f15ad3-4252-4f9c-8de1-ccca837ec1f6 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1" returned: 0 in 1.282s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-863beedb-671e-4ac4-9312-7f23e460e96c req-79f15ad3-4252-4f9c-8de1-ccca837ec1f6 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.321s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:55 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:55 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-863beedb-671e-4ac4-9312-7f23e460e96c req-79f15ad3-4252-4f9c-8de1-ccca837ec1f6 tempest-TestInstancesWithCinderVolumes-1788480100 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-0eaec12b-295a-4986-af8d-7d80dc2650f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88686eb3-08b4-4e98-a3a2-5a65dc4f7f38', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:28:55 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-863beedb-671e-4ac4-9312-7f23e460e96c req-79f15ad3-4252-4f9c-8de1-ccca837ec1f6 tempest-TestInstancesWithCinderVolumes-1788480100 None] attachment_update completed successfully. Jun 04 13:28:56 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.967s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:56 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:56 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Deleted volume successfully. Jun 04 13:28:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5545a58d-0f3b-40e1-9bd1-9caea9708a62 tempest-CreateVolumesFromSnapshotTest-1661311981 None] Lock "cinder-c89ae223-f53d-4e59-8132-5e167496e0a2-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Acquiring lock "cinder-5a7aaf98-5569-4b67-b73e-59f621880c66-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Lock "cinder-5a7aaf98-5569-4b67-b73e-59f621880c66-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Acquiring lock "cinder-quobyte-5a7aaf98-5569-4b67-b73e-59f621880c66" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Lock "cinder-quobyte-5a7aaf98-5569-4b67-b73e-59f621880c66" acquired by "delete_volume" :: waited 0.041s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:56 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[da54baef-a427-4bb0-87f2-1f46edb974bb]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5a7aaf98-5569-4b67-b73e-59f621880c66 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:56 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.208s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:56 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:56 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Deleted volume successfully. Jun 04 13:28:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3d9921e9-6842-4d29-bdf0-45759dbb8c6f tempest-VolumesTestJSON-522030359 None] Lock "cinder-1422b0ed-4d07-45f3-8ea7-627e77c614f1-delete_volume" released by "delete_volume" :: held 3.978s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:56 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5a7aaf98-5569-4b67-b73e-59f621880c66 Jun 04 13:28:56 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:57 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5a7aaf98-5569-4b67-b73e-59f621880c66" returned: 0 in 1.097s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5a7aaf98-5569-4b67-b73e-59f621880c66 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:57 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5a7aaf98-5569-4b67-b73e-59f621880c66 Jun 04 13:28:57 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:58 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5a7aaf98-5569-4b67-b73e-59f621880c66" returned: 0 in 0.688s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Lock "cinder-quobyte-5a7aaf98-5569-4b67-b73e-59f621880c66" released by "delete_volume" :: held 1.869s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Created reservations ['18ee951c-fdb3-4e96-9b0e-3f107e8cc579', '0625a27c-e3e4-4568-b0bf-aec2e8c37c8e', 'eff0928b-068e-401a-ac3e-7755086efb2c', 'c3c84efe-53f6-4952-85d9-d28d4d8be503'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:58 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:28:58 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Acquiring lock "cinder-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Lock "cinder-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Acquiring lock "cinder-quobyte-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Lock "cinder-quobyte-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc" acquired by "delete_volume" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d023cf4-1a82-4619-b9d0-81598379a095]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:28:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:58 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc Jun 04 13:28:58 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:28:59 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.706s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:59 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:28:59 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Deleted volume successfully. Jun 04 13:28:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2568476a-cf6f-4017-94e5-3a43cee1e51b tempest-VolumesTestJSON-522030359 None] Lock "cinder-5a7aaf98-5569-4b67-b73e-59f621880c66-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:28:59 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jun 04 13:28:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc" returned: 0 in 0.824s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:28:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:28:59 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc Jun 04 13:28:59 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:00 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc" returned: 0 in 0.662s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Lock "cinder-quobyte-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc" released by "delete_volume" :: held 1.540s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:00 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Created reservations ['75cf6eb6-27d5-40e0-96e0-7799919ff976', '7fe698fb-f076-4c16-811e-ab8b28880ee6', 'fc76dde9-ddcc-4ed6-9cad-92ec09e47c11', '724749b7-453d-4101-a8d1-8788018bc409'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:29:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:29:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:29:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:00 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:29:00 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:01 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.634s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:01 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:29:01 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Deleted volume successfully. Jun 04 13:29:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2bb91631-e70e-4a40-9882-417b0d77e015 tempest-VolumesTestJSON-522030359 None] Lock "cinder-2180d315-9e2f-4fc7-ae06-1f85c7e9f4bc-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:29:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:29:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:29:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:04 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:29:04 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:04 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.597s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:29:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:29:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:29:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:29:05 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-345a3b3d-36d7-46df-bb8b-602401fdb7e4 req-5823a415-0b74-426c-b83a-c3bd4a4f643e tempest-TestInstancesWithCinderVolumes-1788480100 None] Terminate volume connection completed successfully. Jun 04 13:29:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-345a3b3d-36d7-46df-bb8b-602401fdb7e4 req-5823a415-0b74-426c-b83a-c3bd4a4f643e tempest-TestInstancesWithCinderVolumes-1788480100 None] Deleting attachment 2b139f46-1c25-4827-964d-f7fcb7665e90. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:29:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "cinder-4474d28a-6a15-49f4-9af4-1c5bbb50a246-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "cinder-4474d28a-6a15-49f4-9af4-1c5bbb50a246-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "cinder-quobyte-4474d28a-6a15-49f4-9af4-1c5bbb50a246" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "cinder-quobyte-4474d28a-6a15-49f4-9af4-1c5bbb50a246" acquired by "delete_volume" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:07 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b17f5f0-713d-4e6c-95ef-b6ae9897df38]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:29:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:07 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246 Jun 04 13:29:07 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:07 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246" returned: 0 in 0.821s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:07 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246 Jun 04 13:29:07 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:08 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-81aaa284-5d67-47a2-bd2c-6902048ca1dc tempest-GroupSnapshotsV319Test-1036855353 None] Group tempest-GroupSnapshotsV319Test-Group-1982484522: creating Jun 04 13:29:08 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-81aaa284-5d67-47a2-bd2c-6902048ca1dc tempest-GroupSnapshotsV319Test-1036855353 None] Group tempest-GroupSnapshotsV319Test-Group-1982484522: created successfully Jun 04 13:29:08 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-81aaa284-5d67-47a2-bd2c-6902048ca1dc tempest-GroupSnapshotsV319Test-1036855353 None] Create group completed successfully. Jun 04 13:29:08 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4474d28a-6a15-49f4-9af4-1c5bbb50a246" returned: 0 in 0.635s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:08 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "cinder-quobyte-4474d28a-6a15-49f4-9af4-1c5bbb50a246" released by "delete_volume" :: held 1.505s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:08 devstack cinder-volume[86722]: WARNING cinder.quota [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1896154570-546970354 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1896154570-546970354, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:29:08 devstack cinder-volume[86722]: WARNING cinder.quota [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1896154570-546970354 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1896154570-546970354, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:29:08 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Created reservations ['77e97484-b1c5-4092-b02d-d71acec4e3d2', 'ee8948ab-b777-4bc6-8b40-335e5263133d', '422bf1be-a5ab-48d9-a420-7a43b9726b5a', '1177bc75-258a-4c58-91ac-7e7acd0008d4'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:29:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:29:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:29:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:08 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:29:08 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:09 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.709s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:29:09 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Deleted volume successfully. Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-75f90ac1-b731-4ef8-8284-4019d4691dfc tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "cinder-4474d28a-6a15-49f4-9af4-1c5bbb50a246-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Flow 'volume_create_manager' (781dfafc-3044-4546-9aaf-6b7355d726f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c568e5-4634-425f-9231-6c55dbde1667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c568e5-4634-425f-9231-6c55dbde1667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-48057717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59ec2125-d3ce-47a3-a79a-6eea74a38508,host='devstack@QuobyteHD#QuobyteHD',id=1a8d22fd-0e42-45f3-a5c4-ea3bd415d017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2443317264d41b73c1686cd1949ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:29:10Z,use_quota=True,user_id='212cace598e141248b73a67263a5d7ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f06cf0-7933-4de4-9962-5bacf1ebaaca),volume_type_id=06f06cf0-7933-4de4-9962-5bacf1ebaaca)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690dd74b-c2a0-4acb-add9-20f8f1d8d707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (690dd74b-c2a0-4acb-add9-20f8f1d8d707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5deaa478-46ea-46c8-9323-0081b192eb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5deaa478-46ea-46c8-9323-0081b192eb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a8d22fd-0e42-45f3-a5c4-ea3bd415d017', 'volume_name': 'volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf756fa-74a1-484b-9491-ae5cc576ed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf756fa-74a1-484b-9491-ae5cc576ed0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fe3771-3328-48c2-b5a7-fbc27de71fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:09 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Volume 1a8d22fd-0e42-45f3-a5c4-ea3bd415d017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017', 'volume_size': 1} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59ec2125-d3ce-47a3-a79a-6eea74a38508,created_at=2026-06-04T11:29:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-48057717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59ec2125-d3ce-47a3-a79a-6eea74a38508,host='devstack@QuobyteHD#QuobyteHD',id=1a8d22fd-0e42-45f3-a5c4-ea3bd415d017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb2443317264d41b73c1686cd1949ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:29:10Z,use_quota=True,user_id='212cace598e141248b73a67263a5d7ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06f06cf0-7933-4de4-9962-5bacf1ebaaca),volume_type_id=06f06cf0-7933-4de4-9962-5bacf1ebaaca)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Creating volume 1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:29:09 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:29:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:09 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 1073741824 Jun 04 13:29:09 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:10 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 1073741824" returned: 0 in 0.863s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:10 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 Jun 04 13:29:10 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:11 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017" returned: 0 in 0.738s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:29:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fe3771-3328-48c2-b5a7-fbc27de71fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd0325b-3e55-4395-b1c9-ba7e5bb767be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:11 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Volume volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 (1a8d22fd-0e42-45f3-a5c4-ea3bd415d017): created successfully Jun 04 13:29:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd0325b-3e55-4395-b1c9-ba7e5bb767be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Flow 'volume_create_manager' (781dfafc-3044-4546-9aaf-6b7355d726f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:29:11 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-91395bda-0a9f-47e8-9deb-aeb10165119c tempest-GroupSnapshotsV319Test-1036855353 None] Created volume successfully. Jun 04 13:29:12 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-22ae458a-d679-4c4e-8fd0-a8629610150c req-390c3d11-0e64-47a0-a400-cdba3531ed28 tempest-TestInstancesWithCinderVolumes-1788480100 None] Terminate volume connection completed successfully. Jun 04 13:29:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-22ae458a-d679-4c4e-8fd0-a8629610150c req-390c3d11-0e64-47a0-a400-cdba3531ed28 tempest-TestInstancesWithCinderVolumes-1788480100 None] Deleting attachment 88686eb3-08b4-4e98-a3a2-5a65dc4f7f38. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:29:12 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] GroupSnapshot eb151a07-98ec-429f-a093-fc949b90e2c8: creating. Jun 04 13:29:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] Group snapshot eb151a07-98ec-429f-a093-fc949b90e2c8: creating. {{(pid=86722) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jun 04 13:29:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:12 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] Creating offline snapshot 9259025f-4ffb-468d-840b-d767c3783813 of volume 1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:29:12 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9287b96b-4d6d-429d-b9d6-dce99dab5bce]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:29:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:12 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 Jun 04 13:29:12 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:13 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017" returned: 0 in 0.945s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:13 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 1G Jun 04 13:29:13 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:14 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "cinder-0eaec12b-295a-4986-af8d-7d80dc2650f1-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 1G" returned: 0 in 0.849s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "cinder-0eaec12b-295a-4986-af8d-7d80dc2650f1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:14 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 Jun 04 13:29:14 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "cinder-quobyte-0eaec12b-295a-4986-af8d-7d80dc2650f1" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "cinder-quobyte-0eaec12b-295a-4986-af8d-7d80dc2650f1" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:14 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[870f7c2f-b7e3-4502-8e34-f105c67e62f3]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:29:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:14 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1 Jun 04 13:29:14 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:15 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813" returned: 0 in 0.910s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:15 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:29:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:15 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 Jun 04 13:29:15 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:15 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1" returned: 0 in 0.863s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:15 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1 Jun 04 13:29:15 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:15 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813" returned: 0 in 0.832s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:15 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=118,cinder:UPDATE=141,cinder:INSERT=33,cinder:DELETE=12 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:29:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:16 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.info Jun 04 13:29:16 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:16 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0eaec12b-295a-4986-af8d-7d80dc2650f1" returned: 0 in 0.859s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "cinder-quobyte-0eaec12b-295a-4986-af8d-7d80dc2650f1" released by "delete_volume" :: held 1.830s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:16 devstack cinder-volume[86722]: WARNING cinder.quota [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2076691701-931200614 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2076691701-931200614, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:29:16 devstack cinder-volume[86722]: WARNING cinder.quota [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2076691701-931200614 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2076691701-931200614, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:29:16 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Created reservations ['dd34490f-e652-4cff-a0d2-ea8d2fa0899e', '6a2a4565-54bf-4052-9584-46f7c2b1b920', '1272884e-1858-4352-ac89-a3532a8b27b2', 'fbec508a-2d9f-4354-819d-dbef4d4f287c'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:29:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:16 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:29:16 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:29:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:16 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:29:16 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:16 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.info" returned: 0 in 0.898s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:16 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.info is being set with open permissions: ugo+rw: NotImplementedError Jun 04 13:29:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:16 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.info Jun 04 13:29:16 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:17 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.021s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:17 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:29:17 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Deleted volume successfully. Jun 04 13:29:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6cb5a1ac-61ff-409b-a114-50fd0a62a4ea tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "cinder-0eaec12b-295a-4986-af8d-7d80dc2650f1-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:17 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.info" returned: 0 in 0.775s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.344s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:17 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e0fa73ef-2a2e-4651-8736-d94be7083751 tempest-GroupSnapshotsV319Test-1036855353 None] group_snapshot eb151a07-98ec-429f-a093-fc949b90e2c8: created successfully Jun 04 13:29:19 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] group_snapshot eb151a07-98ec-429f-a093-fc949b90e2c8: deleting Jun 04 13:29:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] group_snapshot eb151a07-98ec-429f-a093-fc949b90e2c8: deleting {{(pid=86722) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jun 04 13:29:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Acquiring lock "cinder-quobyte-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Lock "cinder-quobyte-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Acquiring lock "cinder-quobyte-9259025f-4ffb-468d-840b-d767c3783813" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Lock "cinder-quobyte-9259025f-4ffb-468d-840b-d767c3783813" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Deleting offline snapshot 9259025f-4ffb-468d-840b-d767c3783813 of volume 1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:29:19 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] snapshot_file for this snap is: volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:29:19 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd78887-a82f-48df-8086-28b6b465d0aa]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:29:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:19 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 Jun 04 13:29:19 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:20 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813" returned: 0 in 0.826s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:29:20 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6935e91-c8fb-47a9-b562-3beb95936992]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:29:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:20 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 Jun 04 13:29:20 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:21 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017" returned: 0 in 0.719s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:21 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 Jun 04 13:29:21 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:21 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-8aaa35be-c144-47c2-ae3e-6020e92ec0ce req-efacc524-a76d-4bdb-a718-2c3ee884ac37 tempest-TestInstancesWithCinderVolumes-1788480100 None] Terminate volume connection completed successfully. Jun 04 13:29:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-8aaa35be-c144-47c2-ae3e-6020e92ec0ce req-efacc524-a76d-4bdb-a718-2c3ee884ac37 tempest-TestInstancesWithCinderVolumes-1788480100 None] Deleting attachment 4802f49c-2d00-4c81-82e3-f556799e1c1f. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:29:21 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813" returned: 0 in 0.718s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:21 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813 Jun 04 13:29:21 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:22 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017.9259025f-4ffb-468d-840b-d767c3783813" returned: 0 in 0.635s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Lock "cinder-quobyte-9259025f-4ffb-468d-840b-d767c3783813" released by "_delete_snapshot" :: held 3.005s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Lock "cinder-quobyte-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017" released by "delete_snapshot" :: held 3.040s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:22 devstack cinder-volume[86722]: WARNING cinder.quota [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2098847493 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2098847493, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:29:22 devstack cinder-volume[86722]: WARNING cinder.quota [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2098847493 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2098847493, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:29:22 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] Created reservations ['49f66cd9-1405-4426-961a-14b2dc850bc3', '59a54a5b-d08f-4ebc-b4c4-27b9fde0c231', 'e9cd07f4-bb19-48de-9977-b587b999c962', '9e744046-cdd6-4850-8c6f-58f75c92a96c'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:29:22 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c606d6aa-d281-4597-88db-79e9d4b64422 tempest-GroupSnapshotsV319Test-1036855353 None] group_snapshot eb151a07-98ec-429f-a093-fc949b90e2c8: deleted successfully Jun 04 13:29:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Acquiring lock "cinder-quobyte-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Lock "cinder-quobyte-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017" acquired by "delete_volume" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:22 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f16e4a8-6f53-45cb-a532-66bdba861ee9]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:29:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:23 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 Jun 04 13:29:23 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:23 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017" returned: 0 in 0.732s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:23 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017 Jun 04 13:29:23 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:24 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017" returned: 0 in 0.610s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Lock "cinder-quobyte-1a8d22fd-0e42-45f3-a5c4-ea3bd415d017" released by "delete_volume" :: held 1.412s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Created reservations ['c3cd5f15-b78d-484e-a87c-7b7f8efe2243'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:29:24 devstack cinder-volume[86722]: WARNING cinder.quota [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2098847493 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2098847493, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Created reservations ['bb692922-5cee-48d4-b847-aecd1cd51445', '2226801d-53dd-4c0d-9fcb-85d6842aa930', '2a79a1e1-5c96-40c8-8835-8718bbc00af2', '19e24cb4-a788-48f7-8f58-f0512aeae93e'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:24 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:29:24 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "cinder-673a3b54-95b2-4ad4-b70e-92965b8c1db9-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "cinder-673a3b54-95b2-4ad4-b70e-92965b8c1db9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=171,cinder:SELECT=132,cinder:DELETE=12,cinder:INSERT=37 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "cinder-quobyte-673a3b54-95b2-4ad4-b70e-92965b8c1db9" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "cinder-quobyte-673a3b54-95b2-4ad4-b70e-92965b8c1db9" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddc26b3-fdc4-4de7-afc1-956b67be923b]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:29:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:25 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 Jun 04 13:29:25 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:25 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.725s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:25 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:29:25 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-14e09c4e-1f10-417f-b9d2-1fd636c3f790 tempest-GroupSnapshotsV319Test-1036855353 None] Delete group completed successfully. Jun 04 13:29:25 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9" returned: 0 in 0.845s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:25 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 Jun 04 13:29:25 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:26 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9" returned: 1 in 0.818s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:29:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:26 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9 Jun 04 13:29:26 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:27 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-673a3b54-95b2-4ad4-b70e-92965b8c1db9" returned: 0 in 0.673s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:27 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "cinder-quobyte-673a3b54-95b2-4ad4-b70e-92965b8c1db9" released by "delete_volume" :: held 2.413s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:27 devstack cinder-volume[86722]: WARNING cinder.quota [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1119416380-2132936871 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1119416380-2132936871, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:29:27 devstack cinder-volume[86722]: WARNING cinder.quota [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1119416380-2132936871 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1119416380-2132936871, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:29:27 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Created reservations ['e469c618-6307-4672-8b70-a12ef3ce4d6d', 'ae968911-7e42-4d4b-859e-256df9250e23', '864eca25-2bac-43c8-af95-6f9aa6e1478f', '7f261d91-7908-4d9b-93ec-23985018d494'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:29:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:29:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:29:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:27 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:29:27 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:28 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.621s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:28 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:29:28 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Deleted volume successfully. Jun 04 13:29:28 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9f3843ae-71dd-422c-a43e-3e6f33acf405 tempest-TestInstancesWithCinderVolumes-1788480100 None] Lock "cinder-673a3b54-95b2-4ad4-b70e-92965b8c1db9-delete_volume" released by "delete_volume" :: held 3.316s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:37 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:29:38 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=28,cinder:INSERT=10,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:29:38 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-e15ba4ab-84df-40ee-ab2b-c1e63ab1ce2a req-68774b10-2c90-46a5-a449-fe2589a7c6b2 tempest-TestMinimumBasicScenario-1180715691 None] Terminate volume connection completed successfully. Jun 04 13:29:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-e15ba4ab-84df-40ee-ab2b-c1e63ab1ce2a req-68774b10-2c90-46a5-a449-fe2589a7c6b2 tempest-TestMinimumBasicScenario-1180715691 None] Deleting attachment 67ad3f15-fa4a-4403-8625-79df038fb001. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:29:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Acquiring lock "cinder-917292c1-b5a9-4c5f-a65e-bd33423772de-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Lock "cinder-917292c1-b5a9-4c5f-a65e-bd33423772de-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Acquiring lock "cinder-quobyte-917292c1-b5a9-4c5f-a65e-bd33423772de" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Lock "cinder-quobyte-917292c1-b5a9-4c5f-a65e-bd33423772de" acquired by "delete_volume" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:40 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb4e7df-b795-48f7-b98d-5b4a2f0a7156]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:29:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:40 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de Jun 04 13:29:40 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:41 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de" returned: 0 in 0.746s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:41 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de Jun 04 13:29:41 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:41 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-917292c1-b5a9-4c5f-a65e-bd33423772de" returned: 0 in 0.758s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Lock "cinder-quobyte-917292c1-b5a9-4c5f-a65e-bd33423772de" released by "delete_volume" :: held 1.568s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:42 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Created reservations ['85c2e592-e9b3-440f-84ee-8467f18951f2', 'cad36305-f707-40cd-9611-0b78a14b55b7', '13b0ce0f-c940-4ee3-9c1d-c179211233d8', '29fa3570-fe21-46b7-a791-3de69b4a91fa'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:29:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:29:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:29:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:42 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:29:42 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:42 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.716s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:42 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:29:42 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Deleted volume successfully. Jun 04 13:29:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-71900176-e9dd-4831-b8f5-63eedc2538ec tempest-TestMinimumBasicScenario-1180715691 None] Lock "cinder-917292c1-b5a9-4c5f-a65e-bd33423772de-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Flow 'volume_create_manager' (3b1e4352-7684-4be5-af56-803e14115f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86bbf7c-5ac2-440f-9b6c-c63672533484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c86bbf7c-5ac2-440f-9b6c-c63672533484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1580332027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec4ac0f-1a56-4a55-b74c-883fbba529aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e240046c68f04eaba40ae0c1f88f6844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:29:43Z,use_quota=True,user_id='b3f0306e74aa4d9795a8f7a6fd1448e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636e4036-73cf-4bf5-b81e-feaf400f087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636e4036-73cf-4bf5-b81e-feaf400f087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb76fba0-f64a-403c-9168-214ad3fbcf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb76fba0-f64a-403c-9168-214ad3fbcf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec4ac0f-1a56-4a55-b74c-883fbba529aa', 'volume_name': 'volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ab954c-0c15-4e00-817c-4f5f9bf1134f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ab954c-0c15-4e00-817c-4f5f9bf1134f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34da4920-e65e-41fb-bde6-d32635f8099c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:43 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Volume 5ec4ac0f-1a56-4a55-b74c-883fbba529aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa', 'volume_size': 1} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1580332027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec4ac0f-1a56-4a55-b74c-883fbba529aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e240046c68f04eaba40ae0c1f88f6844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:29:43Z,use_quota=True,user_id='b3f0306e74aa4d9795a8f7a6fd1448e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Creating volume 5ec4ac0f-1a56-4a55-b74c-883fbba529aa {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:29:43 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:29:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:43 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa 1073741824 Jun 04 13:29:43 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:44 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa 1073741824" returned: 0 in 1.065s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:44 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa Jun 04 13:29:44 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:45 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa" returned: 0 in 0.619s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34da4920-e65e-41fb-bde6-d32635f8099c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e67d6e-7f9d-4697-969f-57e20d649007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:45 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Volume volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa (5ec4ac0f-1a56-4a55-b74c-883fbba529aa): created successfully Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e67d6e-7f9d-4697-969f-57e20d649007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Flow 'volume_create_manager' (3b1e4352-7684-4be5-af56-803e14115f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:29:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-80608b4c-ce89-448a-9324-cda4b8b3c685 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Created volume successfully. Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Acquiring lock "cinder-5ec4ac0f-1a56-4a55-b74c-883fbba529aa-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "cinder-5ec4ac0f-1a56-4a55-b74c-883fbba529aa-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Acquiring lock "cinder-quobyte-5ec4ac0f-1a56-4a55-b74c-883fbba529aa" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "cinder-quobyte-5ec4ac0f-1a56-4a55-b74c-883fbba529aa" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[4828434f-e44b-42f9-b05a-a3a5f9573851]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:29:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:46 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa Jun 04 13:29:46 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:46 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa" returned: 0 in 0.818s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:46 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa Jun 04 13:29:46 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:47 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-5ec4ac0f-1a56-4a55-b74c-883fbba529aa" returned: 0 in 0.734s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "cinder-quobyte-5ec4ac0f-1a56-4a55-b74c-883fbba529aa" released by "delete_volume" :: held 1.601s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:47 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Created reservations ['4a59da47-3d6b-4607-8a87-73ada3be4e70', 'f98803d6-5828-4498-9545-11f24da69cc0', 'c8e1c3e9-c493-478a-99a1-f8e378bd4469', '2773f068-da71-45e4-80bf-3af47ae8beee'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:29:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:29:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:29:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:47 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:29:47 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:48 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.781s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:29:48 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Deleted volume successfully. Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-20adcdcb-74af-4296-b916-99904baf2af3 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "cinder-5ec4ac0f-1a56-4a55-b74c-883fbba529aa-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Flow 'volume_create_manager' (83d1e30e-5b70-47bb-92f6-155771c71d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca6fd2c-d15f-4e7c-8ea2-97522ddf2ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca6fd2c-d15f-4e7c-8ea2-97522ddf2ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1116163870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5794853-34a7-43a8-8a0c-5e6717bf8d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e240046c68f04eaba40ae0c1f88f6844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:29:49Z,use_quota=True,user_id='b3f0306e74aa4d9795a8f7a6fd1448e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4b7786-8044-469e-85c3-be67364ff762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4b7786-8044-469e-85c3-be67364ff762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165e0652-a5a6-4ece-926a-c191031cb57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165e0652-a5a6-4ece-926a-c191031cb57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5794853-34a7-43a8-8a0c-5e6717bf8d9b', 'volume_name': 'volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ef5fdf-e5b7-49e5-8a30-163fda3c5f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ef5fdf-e5b7-49e5-8a30-163fda3c5f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5735a688-4687-47a7-a767-91972dead82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:48 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Volume c5794853-34a7-43a8-8a0c-5e6717bf8d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b', 'volume_size': 1} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1116163870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5794853-34a7-43a8-8a0c-5e6717bf8d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e240046c68f04eaba40ae0c1f88f6844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:29:49Z,use_quota=True,user_id='b3f0306e74aa4d9795a8f7a6fd1448e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Creating volume c5794853-34a7-43a8-8a0c-5e6717bf8d9b {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:29:48 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:29:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:48 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b 1073741824 Jun 04 13:29:48 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:49 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b 1073741824" returned: 0 in 0.860s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:49 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b Jun 04 13:29:49 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:50 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b" returned: 0 in 0.602s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:50 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:29:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5735a688-4687-47a7-a767-91972dead82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cfc47eb-449a-455a-8b38-5e94d1967dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:29:50 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Volume volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b (c5794853-34a7-43a8-8a0c-5e6717bf8d9b): created successfully Jun 04 13:29:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cfc47eb-449a-455a-8b38-5e94d1967dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:29:50 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Flow 'volume_create_manager' (83d1e30e-5b70-47bb-92f6-155771c71d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:29:50 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-2b3c49b8-21d2-4a15-831d-6ad81b54fda2 tempest-VolumeQuotasAdminTestJSON-1410715161 None] Created volume successfully. Jun 04 13:29:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-14828bb8-8702-4028-97ec-35e39efedac9 tempest-VolumeQuotasAdminTestJSON-772594912 None] Transfer volume completed successfully. Jun 04 13:29:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Acquiring lock "cinder-c5794853-34a7-43a8-8a0c-5e6717bf8d9b-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Lock "cinder-c5794853-34a7-43a8-8a0c-5e6717bf8d9b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Acquiring lock "cinder-quobyte-c5794853-34a7-43a8-8a0c-5e6717bf8d9b" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:29:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Lock "cinder-quobyte-c5794853-34a7-43a8-8a0c-5e6717bf8d9b" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:29:52 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9faa31b-aa1f-4a84-a05c-2424b6a8d48c]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:29:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:52 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b Jun 04 13:29:52 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:53 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b" returned: 0 in 0.836s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:53 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b Jun 04 13:29:53 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:54 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c5794853-34a7-43a8-8a0c-5e6717bf8d9b" returned: 0 in 0.686s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Lock "cinder-quobyte-c5794853-34a7-43a8-8a0c-5e6717bf8d9b" released by "delete_volume" :: held 1.587s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:29:54 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Created reservations ['8511a9d5-cd9f-4dea-a218-86db87184ed3', 'e55c5085-e890-4630-96bc-8514ce2bfa33', 'af4c751a-7448-4dc3-b989-c69f1d29a73b', '2c1ccd39-8b80-4906-98bc-071dec5d616e'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:29:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:29:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:29:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:29:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:29:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:29:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:29:54 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:29:54 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:29:55 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Jun 04 13:29:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.726s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:29:55 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:29:55 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Deleted volume successfully. Jun 04 13:29:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b9a5a23e-7df4-4067-a20b-b972788f3413 tempest-VolumeQuotasAdminTestJSON-1739965080 None] Lock "cinder-c5794853-34a7-43a8-8a0c-5e6717bf8d9b-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:04 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:30:04 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=21,cinder:INSERT=5,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:30:04 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.733s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:30:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:30:05 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=20,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Flow 'volume_create_manager' (d746ddac-8a71-426d-ae7b-38d1561d8ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b17092-d1ae-4c0d-8689-675e6e58fd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9b17092-d1ae-4c0d-8689-675e6e58fd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-131379674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d88bed-f49f-4462-a188-04c604f67187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbbc7dbac5448da9e4070ed0972daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:07Z,use_quota=True,user_id='bd9914188fcd4977802d85902a76c266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e368c7-8b6d-4f2e-bc95-f30b1412676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e368c7-8b6d-4f2e-bc95-f30b1412676f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee48fb7-9a86-4021-ad02-ab660c3ed76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee48fb7-9a86-4021-ad02-ab660c3ed76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92d88bed-f49f-4462-a188-04c604f67187', 'volume_name': 'volume-92d88bed-f49f-4462-a188-04c604f67187', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08f6c1d-ca6a-4c50-855c-90528bb6eb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08f6c1d-ca6a-4c50-855c-90528bb6eb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b05650e-577d-4ec7-ad90-704cec941e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:06 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Volume 92d88bed-f49f-4462-a188-04c604f67187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92d88bed-f49f-4462-a188-04c604f67187', 'volume_size': 1} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-131379674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92d88bed-f49f-4462-a188-04c604f67187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbbc7dbac5448da9e4070ed0972daaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:07Z,use_quota=True,user_id='bd9914188fcd4977802d85902a76c266',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Creating volume 92d88bed-f49f-4462-a188-04c604f67187 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:30:06 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:30:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:06 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 1073741824 Jun 04 13:30:06 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:07 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 1073741824" returned: 0 in 0.981s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:07 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 Jun 04 13:30:07 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:08 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187" returned: 0 in 0.635s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:30:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b05650e-577d-4ec7-ad90-704cec941e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92d88bed-f49f-4462-a188-04c604f67187', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bc050d-5097-4ada-ac0b-e7d9e3037394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:08 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Volume volume-92d88bed-f49f-4462-a188-04c604f67187 (92d88bed-f49f-4462-a188-04c604f67187): created successfully Jun 04 13:30:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bc050d-5097-4ada-ac0b-e7d9e3037394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Flow 'volume_create_manager' (d746ddac-8a71-426d-ae7b-38d1561d8ffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:08 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-911a58c6-0570-478b-af4d-a522dd9fdcec tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Created volume successfully. Jun 04 13:30:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Creating offline snapshot 24349560-ed49-4e32-b841-081e97d99cc4 of volume 92d88bed-f49f-4462-a188-04c604f67187 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:30:09 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dc4186-174b-425c-893a-3897eb53e9c4]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:30:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:09 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 Jun 04 13:30:09 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:09 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187" returned: 0 in 0.724s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:09 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 1G Jun 04 13:30:09 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:10 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 1G" returned: 0 in 0.824s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d88bed-f49f-4462-a188-04c604f67187 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:10 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d88bed-f49f-4462-a188-04c604f67187 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 Jun 04 13:30:10 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:11 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92d88bed-f49f-4462-a188-04c604f67187 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4" returned: 0 in 0.671s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:11 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 is being set with open permissions: ugo+rw Jun 04 13:30:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:11 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 Jun 04 13:30:11 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:11 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4" returned: 0 in 0.606s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:12 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.info Jun 04 13:30:12 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:12 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.info" returned: 0 in 0.697s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:12 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.info is being set with open permissions: ugo+rw Jun 04 13:30:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:12 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.info Jun 04 13:30:12 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:13 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.info" returned: 0 in 0.749s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.381s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:13 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b555b622-1c64-40e8-9c72-7d10501480c3 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Create snapshot completed successfully Jun 04 13:30:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Acquiring lock "cinder-24349560-ed49-4e32-b841-081e97d99cc4-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:30:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "cinder-24349560-ed49-4e32-b841-081e97d99cc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:30:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Acquiring lock "cinder-quobyte-92d88bed-f49f-4462-a188-04c604f67187" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:30:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "cinder-quobyte-92d88bed-f49f-4462-a188-04c604f67187" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:30:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Acquiring lock "cinder-quobyte-24349560-ed49-4e32-b841-081e97d99cc4" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:30:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "cinder-quobyte-24349560-ed49-4e32-b841-081e97d99cc4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:30:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Deleting offline snapshot 24349560-ed49-4e32-b841-081e97d99cc4 of volume 92d88bed-f49f-4462-a188-04c604f67187 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:30:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] snapshot_file for this snap is: volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:30:14 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c183ce0-8375-471a-ba0a-937763ea2a5f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:30:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:15 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 Jun 04 13:30:15 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:15 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4" returned: 0 in 0.744s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92d88bed-f49f-4462-a188-04c604f67187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:30:15 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[98afb512-4d77-487f-a0ba-02c7ca1273c0]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:30:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:15 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 Jun 04 13:30:15 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:16 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187" returned: 0 in 0.819s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:16 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 Jun 04 13:30:16 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:17 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4" returned: 0 in 0.847s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:17 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4 Jun 04 13:30:17 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:18 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187.24349560-ed49-4e32-b841-081e97d99cc4" returned: 0 in 0.652s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "cinder-quobyte-24349560-ed49-4e32-b841-081e97d99cc4" released by "_delete_snapshot" :: held 3.193s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:30:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "cinder-quobyte-92d88bed-f49f-4462-a188-04c604f67187" released by "delete_snapshot" :: held 3.220s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:30:18 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Created reservations ['4cb45810-ae6d-42d2-a296-9eafd3db7b7f', 'ca477eb5-c5a8-4b7f-a8ac-646cf7949ca3', 'c0098359-11cc-4185-b2aa-f00294d6d9d5', 'b13bc253-68bd-4556-a83f-e4591ec0f26f'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:30:18 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Delete snapshot completed successfully. Jun 04 13:30:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a8f8ff68-0113-430e-8381-50d9d4fc05cc tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "cinder-24349560-ed49-4e32-b841-081e97d99cc4-delete_snapshot" released by "delete_snapshot" :: held 3.364s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:30:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Acquiring lock "cinder-92d88bed-f49f-4462-a188-04c604f67187-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:30:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "cinder-92d88bed-f49f-4462-a188-04c604f67187-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:30:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Acquiring lock "cinder-quobyte-92d88bed-f49f-4462-a188-04c604f67187" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:30:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "cinder-quobyte-92d88bed-f49f-4462-a188-04c604f67187" acquired by "delete_volume" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:30:19 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8e6bf3-f886-40cb-ae4c-6718b9f72c97]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:30:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:19 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 Jun 04 13:30:19 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:20 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187" returned: 0 in 0.901s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:20 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187 Jun 04 13:30:20 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:21 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-92d88bed-f49f-4462-a188-04c604f67187" returned: 0 in 0.666s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:21 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "cinder-quobyte-92d88bed-f49f-4462-a188-04c604f67187" released by "delete_volume" :: held 1.690s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:30:21 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Created reservations ['9c489d0e-5c30-41de-a66d-970a4ae6fb9c', 'e1320e70-8cd8-4974-83a8-db3fea96bb38', '87137b39-c9e4-4d2b-9a42-76ed44706c2b', 'b6150169-5410-4702-8668-dd8004346436'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:30:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:30:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:30:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:21 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:30:21 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:21 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.696s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:21 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:30:21 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Deleted volume successfully. Jun 04 13:30:21 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cdac44ff-df95-4e6b-9226-840064bbe4d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-903630522 None] Lock "cinder-92d88bed-f49f-4462-a188-04c604f67187-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:30:27 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Flow 'volume_create_manager' (5a3b994f-6ddc-4b8f-aa8e-022356ca6a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9949e4-ae6e-48af-bb6f-9cd3d95f5539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a9949e4-ae6e-48af-bb6f-9cd3d95f5539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1361100346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f26273e-bd37-4944-be4b-5b9777742a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec87b50477ee42d99837f65be4acb365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:28Z,use_quota=True,user_id='037c19fd8a95483f8600defb96d4a68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce2fea5-ca5b-4156-851f-052984e0e2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce2fea5-ca5b-4156-851f-052984e0e2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea88936-385f-464c-8f08-051055c1a222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea88936-385f-464c-8f08-051055c1a222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f26273e-bd37-4944-be4b-5b9777742a7e', 'volume_name': 'volume-4f26273e-bd37-4944-be4b-5b9777742a7e', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d91518-bd16-44fe-bc01-68124c709355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d91518-bd16-44fe-bc01-68124c709355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec769e5d-351a-4713-9514-cd468579d86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:28 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Volume 4f26273e-bd37-4944-be4b-5b9777742a7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f26273e-bd37-4944-be4b-5b9777742a7e', 'volume_size': 1} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1361100346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f26273e-bd37-4944-be4b-5b9777742a7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec87b50477ee42d99837f65be4acb365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:28Z,use_quota=True,user_id='037c19fd8a95483f8600defb96d4a68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Creating volume 4f26273e-bd37-4944-be4b-5b9777742a7e {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:30:28 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:28 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e 1073741824 Jun 04 13:30:28 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Flow 'volume_create_manager' (15c6b40a-52a7-4208-8a88-36d61c291ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f9ec68-66e9-4852-bca0-cb878c8e7e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f9ec68-66e9-4852-bca0-cb878c8e7e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1641432529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0a1b5f-d121-4708-bd74-eaa034d9f2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec87b50477ee42d99837f65be4acb365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:29Z,use_quota=True,user_id='037c19fd8a95483f8600defb96d4a68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a72ec6f-69c9-4c3e-aa30-b63d7c45b40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a72ec6f-69c9-4c3e-aa30-b63d7c45b40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026bfadc-3438-499c-b6b8-8a983429b5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026bfadc-3438-499c-b6b8-8a983429b5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f0a1b5f-d121-4708-bd74-eaa034d9f2cf', 'volume_name': 'volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b65d0b2-1c76-4a7b-9f0a-ee2edc31d136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b65d0b2-1c76-4a7b-9f0a-ee2edc31d136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206664a0-3940-4e56-8f83-785761041f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:29 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Volume 4f0a1b5f-d121-4708-bd74-eaa034d9f2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf', 'volume_size': 1} Jun 04 13:30:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:29 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e 1073741824" returned: 0 in 1.195s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:29 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e Jun 04 13:30:29 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:30 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e" returned: 0 in 0.813s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.116s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.232s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1641432529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0a1b5f-d121-4708-bd74-eaa034d9f2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec87b50477ee42d99837f65be4acb365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:29Z,use_quota=True,user_id='037c19fd8a95483f8600defb96d4a68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Creating volume 4f0a1b5f-d121-4708-bd74-eaa034d9f2cf {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:30:30 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec769e5d-351a-4713-9514-cd468579d86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f26273e-bd37-4944-be4b-5b9777742a7e', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ea1a51-b7e7-457d-88b5-addaa5a35ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:30 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf 1073741824 Jun 04 13:30:30 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:30 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Volume volume-4f26273e-bd37-4944-be4b-5b9777742a7e (4f26273e-bd37-4944-be4b-5b9777742a7e): created successfully Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ea1a51-b7e7-457d-88b5-addaa5a35ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Flow 'volume_create_manager' (5a3b994f-6ddc-4b8f-aa8e-022356ca6a0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:30 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b01d12bc-5255-464f-9ba5-c811cf04ad43 tempest-TestServerVolumeAttachmentScenario-681105202 None] Created volume successfully. Jun 04 13:30:31 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf 1073741824" returned: 0 in 1.265s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:31 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf Jun 04 13:30:31 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:32 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf" returned: 0 in 0.996s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:30:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.346s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206664a0-3940-4e56-8f83-785761041f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e9738c-9e01-4192-8843-471bea8cb007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:32 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Volume volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf (4f0a1b5f-d121-4708-bd74-eaa034d9f2cf): created successfully Jun 04 13:30:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e9738c-9e01-4192-8843-471bea8cb007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Flow 'volume_create_manager' (15c6b40a-52a7-4208-8a88-36d61c291ffb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:32 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a7786058-aed8-4c2f-bc3a-4f193f266f01 tempest-TestServerVolumeAttachmentScenario-681105202 None] Created volume successfully. Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Flow 'volume_create_manager' (f603e50e-4df1-4401-9c9b-880c4b67ef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a35d73d-0056-4221-85c2-6f2b96b2cdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a35d73d-0056-4221-85c2-6f2b96b2cdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-648676724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622b4646-e62c-416a-9f99-bb00b2caafbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b26674cd8d14de3ad3a301e55f85bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:35Z,use_quota=True,user_id='76fab0dd524d4f3fa88846f4e8831ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f57739e4-f2b0-455d-9f9a-6bfb8e9888cc),volume_type_id=f57739e4-f2b0-455d-9f9a-6bfb8e9888cc)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e083496-bbd2-4d04-adf3-4b88e9ecf3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e083496-bbd2-4d04-adf3-4b88e9ecf3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c755ae4-1d8c-4076-ba41-f1792efff8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c755ae4-1d8c-4076-ba41-f1792efff8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622b4646-e62c-416a-9f99-bb00b2caafbf', 'volume_name': 'volume-622b4646-e62c-416a-9f99-bb00b2caafbf', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3e1b7b-dfb0-408f-a9c7-91ef2442eae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3e1b7b-dfb0-408f-a9c7-91ef2442eae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18a9180-56d0-4f30-a2a6-e8a7274335af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:35 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Volume 622b4646-e62c-416a-9f99-bb00b2caafbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622b4646-e62c-416a-9f99-bb00b2caafbf', 'volume_size': 1} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-648676724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622b4646-e62c-416a-9f99-bb00b2caafbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b26674cd8d14de3ad3a301e55f85bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:35Z,use_quota=True,user_id='76fab0dd524d4f3fa88846f4e8831ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f57739e4-f2b0-455d-9f9a-6bfb8e9888cc),volume_type_id=f57739e4-f2b0-455d-9f9a-6bfb8e9888cc)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Creating volume 622b4646-e62c-416a-9f99-bb00b2caafbf {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:30:35 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:30:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-622b4646-e62c-416a-9f99-bb00b2caafbf 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:35 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-622b4646-e62c-416a-9f99-bb00b2caafbf 1073741824 Jun 04 13:30:35 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:36 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-622b4646-e62c-416a-9f99-bb00b2caafbf 1073741824" returned: 0 in 0.809s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-622b4646-e62c-416a-9f99-bb00b2caafbf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:36 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-622b4646-e62c-416a-9f99-bb00b2caafbf Jun 04 13:30:36 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:36 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-622b4646-e62c-416a-9f99-bb00b2caafbf" returned: 0 in 0.646s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:30:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18a9180-56d0-4f30-a2a6-e8a7274335af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622b4646-e62c-416a-9f99-bb00b2caafbf', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1174641a-b96f-4495-b770-f7afe5f43171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:36 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Volume volume-622b4646-e62c-416a-9f99-bb00b2caafbf (622b4646-e62c-416a-9f99-bb00b2caafbf): created successfully Jun 04 13:30:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1174641a-b96f-4495-b770-f7afe5f43171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Flow 'volume_create_manager' (f603e50e-4df1-4401-9c9b-880c4b67ef8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:36 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-bb53d081-b10e-4b81-b1e4-6fb369e03e89 tempest-VolumeTypesAccessTest-864690672 None] Created volume successfully. Jun 04 13:30:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Acquiring lock "cinder-622b4646-e62c-416a-9f99-bb00b2caafbf-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:30:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Lock "cinder-622b4646-e62c-416a-9f99-bb00b2caafbf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:30:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Acquiring lock "cinder-quobyte-622b4646-e62c-416a-9f99-bb00b2caafbf" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:30:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Lock "cinder-quobyte-622b4646-e62c-416a-9f99-bb00b2caafbf" acquired by "delete_volume" :: waited 0.013s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:30:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[03515616-5632-4ab0-bc11-9f05439da0bb]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:30:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-622b4646-e62c-416a-9f99-bb00b2caafbf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:37 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-622b4646-e62c-416a-9f99-bb00b2caafbf Jun 04 13:30:37 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:38 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-622b4646-e62c-416a-9f99-bb00b2caafbf" returned: 0 in 0.761s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-622b4646-e62c-416a-9f99-bb00b2caafbf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:38 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-622b4646-e62c-416a-9f99-bb00b2caafbf Jun 04 13:30:38 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:38 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-622b4646-e62c-416a-9f99-bb00b2caafbf" returned: 0 in 0.688s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Lock "cinder-quobyte-622b4646-e62c-416a-9f99-bb00b2caafbf" released by "delete_volume" :: held 1.490s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:30:39 devstack cinder-volume[86722]: WARNING cinder.quota [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-904931301 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-904931301, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:30:39 devstack cinder-volume[86722]: WARNING cinder.quota [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-904931301 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-904931301, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:30:39 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Created reservations ['9789260c-559b-488b-b20e-3ae70a8a1737', 'ed1db5f2-4e8d-42d3-b72c-4db4599be541', 'cb7986dd-7f15-418c-b8f5-4a2a7fd90097', '2621ebc1-136e-4fce-86fc-81b9bd1d9035'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:30:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:30:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:30:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:39 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:30:39 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:39 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.760s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:39 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:30:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Deleted volume successfully. Jun 04 13:30:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8095c2a8-263f-4b91-8d41-36e29a8fa8a0 tempest-VolumeTypesAccessTest-864690672 None] Lock "cinder-622b4646-e62c-416a-9f99-bb00b2caafbf-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Flow 'volume_create_manager' (309ec85b-f83b-439a-ad7b-81fd896c0156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129e75f1-c759-44cf-8b35-e076d5b61d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (129e75f1-c759-44cf-8b35-e076d5b61d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1863836773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1e2f27-e5ef-4799-bdcc-a4c57e42b125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f5c9788ece247b28a61a29d344aa75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:47Z,use_quota=True,user_id='c1198aa02431408cafe654ff55ea580b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (782f0d09-fe14-4cfc-bfe9-831d979c59dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (782f0d09-fe14-4cfc-bfe9-831d979c59dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2241a963-8e5a-4e40-bdd8-b407cc6cb999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2241a963-8e5a-4e40-bdd8-b407cc6cb999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1e2f27-e5ef-4799-bdcc-a4c57e42b125', 'volume_name': 'volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da952e77-536c-49a8-9a07-1157c31b6112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da952e77-536c-49a8-9a07-1157c31b6112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d6eac3-af40-426f-af25-a422af2f1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:47 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Volume 4f1e2f27-e5ef-4799-bdcc-a4c57e42b125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125', 'volume_size': 1} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1863836773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1e2f27-e5ef-4799-bdcc-a4c57e42b125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f5c9788ece247b28a61a29d344aa75f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:47Z,use_quota=True,user_id='c1198aa02431408cafe654ff55ea580b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Creating volume 4f1e2f27-e5ef-4799-bdcc-a4c57e42b125 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:30:47 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:30:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:47 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125 1073741824 Jun 04 13:30:47 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:48 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125 1073741824" returned: 0 in 1.136s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:48 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125 Jun 04 13:30:48 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:49 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125" returned: 0 in 0.669s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14d6eac3-af40-426f-af25-a422af2f1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5dc0104-20e8-49a5-88ea-7dcc0c48ee98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:49 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Volume volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125 (4f1e2f27-e5ef-4799-bdcc-a4c57e42b125): created successfully Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5dc0104-20e8-49a5-88ea-7dcc0c48ee98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Flow 'volume_create_manager' (309ec85b-f83b-439a-ad7b-81fd896c0156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:49 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-7f3250ab-9e0b-4a2a-a031-80df5bc6dd83 tempest-AbsoluteLimitsTests-1866153734 None] Created volume successfully. Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Acquiring lock "cinder-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Lock "cinder-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Acquiring lock "cinder-quobyte-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Lock "cinder-quobyte-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc327d3-3855-4e9c-a2d0-45d13f77b58e]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:30:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:49 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125 Jun 04 13:30:49 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:50 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125" returned: 0 in 0.711s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:50 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125 Jun 04 13:30:50 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:51 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125" returned: 0 in 0.633s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Lock "cinder-quobyte-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125" released by "delete_volume" :: held 1.396s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:30:51 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Created reservations ['ce7badb5-f97f-4246-8d29-70b68993ca94', '56b1a805-ab15-4e01-b8d1-0cb45407ba47', '71f48e53-2118-46e8-b899-824d5c363488', '2aab678c-2409-4a24-9e47-dd4d13c06232'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:30:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:30:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:30:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:51 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:30:51 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:51 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.640s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:51 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:30:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Deleted volume successfully. Jun 04 13:30:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7e6cc2ed-9ca7-4044-8c42-19d0ebb3a5f0 tempest-AbsoluteLimitsTests-1866153734 None] Lock "cinder-4f1e2f27-e5ef-4799-bdcc-a4c57e42b125-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Flow 'volume_create_manager' (8d715591-0af4-40ce-8098-b3c2ceabfae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f8cb7b-f94d-4bb2-8da7-9b8f9e5a6001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f8cb7b-f94d-4bb2-8da7-9b8f9e5a6001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-385689875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0caad96-49a2-4ae7-9aec-29f740cebb16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6e3d8870e3427d973f77b27413c1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:53Z,use_quota=True,user_id='fb0bec8bcd274b568cc1e3c20c63017b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f128448-1774-4e9c-b95c-2855a5167e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f128448-1774-4e9c-b95c-2855a5167e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3bc608-feeb-439f-a296-882381eb5e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3bc608-feeb-439f-a296-882381eb5e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0caad96-49a2-4ae7-9aec-29f740cebb16', 'volume_name': 'volume-b0caad96-49a2-4ae7-9aec-29f740cebb16', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed546da-2781-4586-8024-69e91ee76c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed546da-2781-4586-8024-69e91ee76c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff92cc25-7bb2-4bb8-9890-f84edbcfd7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:52 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Volume b0caad96-49a2-4ae7-9aec-29f740cebb16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0caad96-49a2-4ae7-9aec-29f740cebb16', 'volume_size': 1} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-385689875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0caad96-49a2-4ae7-9aec-29f740cebb16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6e3d8870e3427d973f77b27413c1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:53Z,use_quota=True,user_id='fb0bec8bcd274b568cc1e3c20c63017b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Creating volume b0caad96-49a2-4ae7-9aec-29f740cebb16 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:30:52 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:30:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:52 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16 1073741824 Jun 04 13:30:52 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:53 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16 1073741824" returned: 0 in 1.066s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:53 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16 Jun 04 13:30:54 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:54 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16" returned: 0 in 0.718s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:30:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff92cc25-7bb2-4bb8-9890-f84edbcfd7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0caad96-49a2-4ae7-9aec-29f740cebb16', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348ebc23-acc7-4374-8cac-1d114b8b0c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:54 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Volume volume-b0caad96-49a2-4ae7-9aec-29f740cebb16 (b0caad96-49a2-4ae7-9aec-29f740cebb16): created successfully Jun 04 13:30:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348ebc23-acc7-4374-8cac-1d114b8b0c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Flow 'volume_create_manager' (8d715591-0af4-40ce-8098-b3c2ceabfae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:54 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-837f128a-c6be-46ee-9091-b7a545412779 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Created volume successfully. Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Flow 'volume_create_manager' (9aa3f7ed-c226-47ea-9920-b6f579d0e783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce35a29-b1b5-45ae-ac06-cb3d53f6bc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ce35a29-b1b5-45ae-ac06-cb3d53f6bc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-135038510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bbd436-224a-43d4-a645-74839e580ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282d0f39cc7543eb9f1eef3f82ae1a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:58Z,use_quota=True,user_id='afc7c65275d645d9b3d188f597fd6b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54469232-82e4-4972-8728-7de709f2d321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54469232-82e4-4972-8728-7de709f2d321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fdaeae-2d9f-4cba-b246-d429011c2c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fdaeae-2d9f-4cba-b246-d429011c2c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44bbd436-224a-43d4-a645-74839e580ef7', 'volume_name': 'volume-44bbd436-224a-43d4-a645-74839e580ef7', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01554794-26d2-4f65-ae60-9357113842cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01554794-26d2-4f65-ae60-9357113842cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5125f8b4-1ecc-4595-810c-56907daabd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:58 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Volume 44bbd436-224a-43d4-a645-74839e580ef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44bbd436-224a-43d4-a645-74839e580ef7', 'volume_size': 1} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-135038510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44bbd436-224a-43d4-a645-74839e580ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282d0f39cc7543eb9f1eef3f82ae1a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:30:58Z,use_quota=True,user_id='afc7c65275d645d9b3d188f597fd6b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Creating volume 44bbd436-224a-43d4-a645-74839e580ef7 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:30:58 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-44bbd436-224a-43d4-a645-74839e580ef7 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:58 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-44bbd436-224a-43d4-a645-74839e580ef7 1073741824 Jun 04 13:30:58 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-e70fa406-d2f4-410c-a5f6-147e8c843452 req-d165fdce-0bed-4fa0-a7a5-47bade99a27c tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:30:59 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-44bbd436-224a-43d4-a645-74839e580ef7 1073741824" returned: 0 in 0.849s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-44bbd436-224a-43d4-a645-74839e580ef7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:59 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-44bbd436-224a-43d4-a645-74839e580ef7 Jun 04 13:30:59 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:30:59 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jun 04 13:30:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-44bbd436-224a-43d4-a645-74839e580ef7" returned: 0 in 0.601s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:30:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:30:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:30:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-e70fa406-d2f4-410c-a5f6-147e8c843452 req-d165fdce-0bed-4fa0-a7a5-47bade99a27c tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.408s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:30:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5125f8b4-1ecc-4595-810c-56907daabd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44bbd436-224a-43d4-a645-74839e580ef7', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67735b72-b1ed-4728-b396-df7330e5bb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:30:59 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccc145b-050c-4425-a893-e04972f641b3]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:30:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-e70fa406-d2f4-410c-a5f6-147e8c843452 req-d165fdce-0bed-4fa0-a7a5-47bade99a27c tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:30:59 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Volume volume-44bbd436-224a-43d4-a645-74839e580ef7 (44bbd436-224a-43d4-a645-74839e580ef7): created successfully Jun 04 13:30:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67735b72-b1ed-4728-b396-df7330e5bb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:30:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Flow 'volume_create_manager' (9aa3f7ed-c226-47ea-9920-b6f579d0e783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:31:00 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-75710028-d10f-45eb-af3e-7932b784c0a1 tempest-VolumesTransfersTest-650721673 None] Created volume successfully. Jun 04 13:31:00 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16 Jun 04 13:31:00 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:00 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-e70fa406-d2f4-410c-a5f6-147e8c843452 req-d165fdce-0bed-4fa0-a7a5-47bade99a27c tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16" returned: 0 in 0.727s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-e70fa406-d2f4-410c-a5f6-147e8c843452 req-d165fdce-0bed-4fa0-a7a5-47bade99a27c tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.756s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-e70fa406-d2f4-410c-a5f6-147e8c843452 req-d165fdce-0bed-4fa0-a7a5-47bade99a27c tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-b0caad96-49a2-4ae7-9aec-29f740cebb16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99efc262-77c0-4ba3-a266-2bf860855197', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:31:00 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-e70fa406-d2f4-410c-a5f6-147e8c843452 req-d165fdce-0bed-4fa0-a7a5-47bade99a27c tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] attachment_update completed successfully. Jun 04 13:31:00 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b6f6ffc7-250b-405b-b811-726773002b3f tempest-VolumesTransfersTest-1393014405 None] Transfer volume completed successfully. Jun 04 13:31:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Acquiring lock "cinder-44bbd436-224a-43d4-a645-74839e580ef7-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Lock "cinder-44bbd436-224a-43d4-a645-74839e580ef7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Acquiring lock "cinder-quobyte-44bbd436-224a-43d4-a645-74839e580ef7" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Lock "cinder-quobyte-44bbd436-224a-43d4-a645-74839e580ef7" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:01 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2671dd-966b-4416-a7ab-cfa26f9efddf]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-44bbd436-224a-43d4-a645-74839e580ef7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:02 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-44bbd436-224a-43d4-a645-74839e580ef7 Jun 04 13:31:02 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:02 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-44bbd436-224a-43d4-a645-74839e580ef7" returned: 0 in 0.730s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-44bbd436-224a-43d4-a645-74839e580ef7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:02 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-44bbd436-224a-43d4-a645-74839e580ef7 Jun 04 13:31:02 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:03 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-44bbd436-224a-43d4-a645-74839e580ef7" returned: 0 in 0.622s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:03 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Lock "cinder-quobyte-44bbd436-224a-43d4-a645-74839e580ef7" released by "delete_volume" :: held 1.408s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:03 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Created reservations ['e829f6e0-6d62-44b8-b6c7-ed3256b50295', '9048dbf8-2175-425c-b9d5-60d19e27be38', 'e6476a2a-ae9f-4110-b71e-cb8b9a454b2e', '9c0a4492-e963-4722-b0e0-e2e239caa287'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:31:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:31:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:31:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:03 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:31:03 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:04 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.622s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:04 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:31:04 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:04 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Deleted volume successfully. Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9ff2ea23-0586-4479-8e07-3aee1fc62c3a tempest-VolumesTransfersTest-403446233 None] Lock "cinder-44bbd436-224a-43d4-a645-74839e580ef7-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=50,cinder:INSERT=14,cinder:UPDATE=58,cinder:DELETE=4 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Flow 'volume_create_manager' (0860b87c-19f7-4aba-93e8-95001a46c751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d9cba3-6002-49a5-a828-5e31f699571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d9cba3-6002-49a5-a828-5e31f699571a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1866330479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33e8fe4-12ad-438b-9b34-52c15b7a7849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282d0f39cc7543eb9f1eef3f82ae1a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:31:05Z,use_quota=True,user_id='afc7c65275d645d9b3d188f597fd6b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd77ac4-575d-4575-9441-ea408b630d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bd77ac4-575d-4575-9441-ea408b630d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e9a6fe-c851-41df-98da-3de6c84d72e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e9a6fe-c851-41df-98da-3de6c84d72e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e33e8fe4-12ad-438b-9b34-52c15b7a7849', 'volume_name': 'volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de71ef75-8016-4105-a839-2a7b6c86c038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de71ef75-8016-4105-a839-2a7b6c86c038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8576e228-521b-474e-af3a-6eb2fad70ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:04 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Volume e33e8fe4-12ad-438b-9b34-52c15b7a7849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849', 'volume_size': 1} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1866330479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e33e8fe4-12ad-438b-9b34-52c15b7a7849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282d0f39cc7543eb9f1eef3f82ae1a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:31:05Z,use_quota=True,user_id='afc7c65275d645d9b3d188f597fd6b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Creating volume e33e8fe4-12ad-438b-9b34-52c15b7a7849 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:31:04 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:04 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.710s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:31:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:31:04 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849 1073741824 Jun 04 13:31:04 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:05 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849 1073741824" returned: 0 in 0.797s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:05 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=51,cinder:UPDATE=67,cinder:DELETE=8,cinder:INSERT=15 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:31:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:05 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849 Jun 04 13:31:05 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:06 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849" returned: 0 in 0.603s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:31:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8576e228-521b-474e-af3a-6eb2fad70ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e6c36e-4925-4153-b9c0-75ae4299d019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:06 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Volume volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849 (e33e8fe4-12ad-438b-9b34-52c15b7a7849): created successfully Jun 04 13:31:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e6c36e-4925-4153-b9c0-75ae4299d019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:06 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Flow 'volume_create_manager' (0860b87c-19f7-4aba-93e8-95001a46c751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:31:06 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1afa97c5-0550-4a3f-8cd5-885653534d1e tempest-VolumesTransfersTest-650721673 None] Created volume successfully. Jun 04 13:31:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Acquiring lock "cinder-e33e8fe4-12ad-438b-9b34-52c15b7a7849-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Lock "cinder-e33e8fe4-12ad-438b-9b34-52c15b7a7849-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Acquiring lock "cinder-quobyte-e33e8fe4-12ad-438b-9b34-52c15b7a7849" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Lock "cinder-quobyte-e33e8fe4-12ad-438b-9b34-52c15b7a7849" acquired by "delete_volume" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:07 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe8129b-2f6d-49c3-b477-6db39c49bb39]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:07 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849 Jun 04 13:31:07 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:08 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849" returned: 0 in 0.729s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:08 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849 Jun 04 13:31:08 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:08 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-d96b8747-353f-4b2a-a598-153bb672787a req-7cd025cd-5a22-4dad-9688-0fba51338ee1 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Terminate volume connection completed successfully. Jun 04 13:31:08 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-d96b8747-353f-4b2a-a598-153bb672787a req-7cd025cd-5a22-4dad-9688-0fba51338ee1 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Deleting attachment 99efc262-77c0-4ba3-a266-2bf860855197. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:31:08 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e33e8fe4-12ad-438b-9b34-52c15b7a7849" returned: 0 in 0.663s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:08 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Lock "cinder-quobyte-e33e8fe4-12ad-438b-9b34-52c15b7a7849" released by "delete_volume" :: held 1.436s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:08 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Created reservations ['d3959df8-f4b8-4d55-bc47-c3b80e3495d6', 'cc702239-784a-4740-9a42-1d17c18ee045', '6adfaa3b-d7c9-427f-98c6-29be3d20dc1c', 'bd0fa6b0-141e-4491-a5dc-ec8546336cb9'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:31:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:31:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:31:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:08 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:31:08 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:09 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.609s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:09 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:31:09 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Deleted volume successfully. Jun 04 13:31:09 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-34dc154a-1d3a-4139-8f42-04f5b83fc625 tempest-VolumesTransfersTest-403446233 None] Lock "cinder-e33e8fe4-12ad-438b-9b34-52c15b7a7849-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:10 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Acquiring lock "cinder-b0caad96-49a2-4ae7-9aec-29f740cebb16-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:10 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Lock "cinder-b0caad96-49a2-4ae7-9aec-29f740cebb16-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:10 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Acquiring lock "cinder-quobyte-b0caad96-49a2-4ae7-9aec-29f740cebb16" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:10 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Lock "cinder-quobyte-b0caad96-49a2-4ae7-9aec-29f740cebb16" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:10 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c13203-2821-4bd4-b533-f337fcbd9410]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:10 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16 Jun 04 13:31:10 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:11 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16" returned: 0 in 0.759s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:11 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16 Jun 04 13:31:11 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:12 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-b0caad96-49a2-4ae7-9aec-29f740cebb16" returned: 0 in 0.679s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:12 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Lock "cinder-quobyte-b0caad96-49a2-4ae7-9aec-29f740cebb16" released by "delete_volume" :: held 1.492s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:12 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Created reservations ['1f49604e-7830-48dc-a5c4-234332092737', '53cf147f-566c-4ff9-8e22-aa3fc18ea496', '1e02dda9-3466-4aab-9396-30f90eafa8c9', '3e7f1c3f-1772-4c1b-8891-f96f95a6b667'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:31:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:12 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:31:12 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:31:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:12 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:31:12 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:12 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.672s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:12 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:31:12 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Deleted volume successfully. Jun 04 13:31:12 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-80f1c8fc-5f3d-4b5b-a4fe-ffcd371a6d94 tempest-TestServerVolumeAttachScenarioOldVersion-867186194 None] Lock "cinder-b0caad96-49a2-4ae7-9aec-29f740cebb16-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-4b337fbf-e4ed-4ec5-adb2-edccacb3cc98 req-5df001fb-ccbb-4f99-8493-11d943171da3 tempest-TestServerVolumeAttachmentScenario-681105202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-4b337fbf-e4ed-4ec5-adb2-edccacb3cc98 req-5df001fb-ccbb-4f99-8493-11d943171da3 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:13 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bfcf50-18e9-4f67-9147-6898b60283db]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-4b337fbf-e4ed-4ec5-adb2-edccacb3cc98 req-5df001fb-ccbb-4f99-8493-11d943171da3 tempest-TestServerVolumeAttachmentScenario-681105202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:13 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e Jun 04 13:31:13 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:14 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-4b337fbf-e4ed-4ec5-adb2-edccacb3cc98 req-5df001fb-ccbb-4f99-8493-11d943171da3 tempest-TestServerVolumeAttachmentScenario-681105202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e" returned: 0 in 0.950s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-4b337fbf-e4ed-4ec5-adb2-edccacb3cc98 req-5df001fb-ccbb-4f99-8493-11d943171da3 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.975s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-4b337fbf-e4ed-4ec5-adb2-edccacb3cc98 req-5df001fb-ccbb-4f99-8493-11d943171da3 tempest-TestServerVolumeAttachmentScenario-681105202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-4f26273e-bd37-4944-be4b-5b9777742a7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7c7cb22-3af2-4f36-bea5-8bcef371ac53', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:31:14 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-4b337fbf-e4ed-4ec5-adb2-edccacb3cc98 req-5df001fb-ccbb-4f99-8493-11d943171da3 tempest-TestServerVolumeAttachmentScenario-681105202 None] attachment_update completed successfully. Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Flow 'volume_create_manager' (06f9a18a-8764-48e0-9a1f-5c19f5cd930e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b106be09-8666-45a3-840a-2cc698c05f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b106be09-8666-45a3-840a-2cc698c05f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1790168568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e76f531-3a3c-468c-88db-462038bc8c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521bf621040b40a6ba087373b24afdbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:31:15Z,use_quota=True,user_id='ed68c11397fe4ace96c5a2cf39f0963c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706281cd-7fff-4335-a333-0648910dc7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706281cd-7fff-4335-a333-0648910dc7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673034f1-9b1e-4419-9171-81d6f7239145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (673034f1-9b1e-4419-9171-81d6f7239145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e76f531-3a3c-468c-88db-462038bc8c84', 'volume_name': 'volume-9e76f531-3a3c-468c-88db-462038bc8c84', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2da4b1-3cd4-46c2-b914-c87caa8d48c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2da4b1-3cd4-46c2-b914-c87caa8d48c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f7659e-d4ce-406b-b5ac-c11e26f70462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:15 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Volume 9e76f531-3a3c-468c-88db-462038bc8c84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e76f531-3a3c-468c-88db-462038bc8c84', 'volume_size': 1} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1790168568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e76f531-3a3c-468c-88db-462038bc8c84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521bf621040b40a6ba087373b24afdbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:31:15Z,use_quota=True,user_id='ed68c11397fe4ace96c5a2cf39f0963c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Creating volume 9e76f531-3a3c-468c-88db-462038bc8c84 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:31:15 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:31:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:15 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 1073741824 Jun 04 13:31:15 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:16 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 1073741824" returned: 0 in 0.904s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:16 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 Jun 04 13:31:16 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:16 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84" returned: 0 in 0.640s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:16 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:31:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f7659e-d4ce-406b-b5ac-c11e26f70462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e76f531-3a3c-468c-88db-462038bc8c84', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46c349a-7ab6-41ee-a276-b8a8ef687f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:16 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Volume volume-9e76f531-3a3c-468c-88db-462038bc8c84 (9e76f531-3a3c-468c-88db-462038bc8c84): created successfully Jun 04 13:31:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46c349a-7ab6-41ee-a276-b8a8ef687f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:16 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Flow 'volume_create_manager' (06f9a18a-8764-48e0-9a1f-5c19f5cd930e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:31:16 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d78fd951-16fe-4840-a658-0e3193aa9eba tempest-VolumesCloneTest-1789911339 None] Created volume successfully. Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Flow 'volume_create_manager' (b1516d5c-fc8a-45f5-b7e0-ad07f9485c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64fe5ea-4278-4b76-966b-f10bdb141065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e64fe5ea-4278-4b76-966b-f10bdb141065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1932474551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3c0bc0-a279-4914-bc5c-c91a112e69cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521bf621040b40a6ba087373b24afdbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:31:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9e76f531-3a3c-468c-88db-462038bc8c84,status='creating',terminated_at=None,updated_at=2026-06-04T11:31:18Z,use_quota=True,user_id='ed68c11397fe4ace96c5a2cf39f0963c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c3b418-6876-4ec1-8c9e-ec1f03e274dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c3b418-6876-4ec1-8c9e-ec1f03e274dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658c8d8a-0ad0-4136-b65f-cfe44fab78f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658c8d8a-0ad0-4136-b65f-cfe44fab78f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2d3c0bc0-a279-4914-bc5c-c91a112e69cd', 'volume_name': 'volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd', 'volume_size': 2, 'source_volid': '9e76f531-3a3c-468c-88db-462038bc8c84', 'source_volstatus': 'available'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563d3f2b-3416-43bc-a6cf-f5aca10b82f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563d3f2b-3416-43bc-a6cf-f5aca10b82f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a7f6a1-81a2-4740-b7e5-a74596530b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:17 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Volume 2d3c0bc0-a279-4914-bc5c-c91a112e69cd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd', 'volume_size': 2, 'source_volid': '9e76f531-3a3c-468c-88db-462038bc8c84', 'source_volstatus': 'available'} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:17 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Cloning volume 9e76f531-3a3c-468c-88db-462038bc8c84 to volume 2d3c0bc0-a279-4914-bc5c-c91a112e69cd Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Creating offline snapshot 26db17af-9cec-474a-aa04-8300300da193 of volume 9e76f531-3a3c-468c-88db-462038bc8c84 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd7116e-da18-4144-9a50-5cda4ebbdaa9]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:17 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 Jun 04 13:31:17 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:18 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84" returned: 0 in 0.742s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:18 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 1G Jun 04 13:31:18 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:19 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 1G" returned: 0 in 0.872s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e76f531-3a3c-468c-88db-462038bc8c84 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:19 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e76f531-3a3c-468c-88db-462038bc8c84 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 Jun 04 13:31:19 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:20 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e76f531-3a3c-468c-88db-462038bc8c84 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193" returned: 0 in 0.661s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:20 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 is being set with open permissions: ugo+rw Jun 04 13:31:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:20 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 Jun 04 13:31:20 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:20 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193" returned: 0 in 0.668s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:20 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.info Jun 04 13:31:20 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:21 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.info" returned: 0 in 0.673s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:21 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.info is being set with open permissions: ugo+rw Jun 04 13:31:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:21 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.info Jun 04 13:31:21 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:22 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.info" returned: 0 in 0.691s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Acquiring lock "cinder-quobyte-2d3c0bc0-a279-4914-bc5c-c91a112e69cd" by "_copy_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Lock "cinder-quobyte-2d3c0bc0-a279-4914-bc5c-c91a112e69cd" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] snapshot: 26db17af-9cec-474a-aa04-8300300da193, volume: 2d3c0bc0-a279-4914-bc5c-c91a112e69cd, {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 13:31:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:31:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:31:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:22 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d707d5-f13a-477e-aa29-48ad754fbbeb]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:22 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 Jun 04 13:31:22 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:23 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193" returned: 0 in 0.809s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e76f531-3a3c-468c-88db-462038bc8c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:31:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 13:31:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Creating direct copy from snapshot {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 13:31:23 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96da8fa-f383-47ca-9409-cff0873a43ce]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:23 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 Jun 04 13:31:23 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:23 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84" returned: 0 in 0.764s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:23 devstack cinder-volume[86722]: DEBUG cinder.utils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Path /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd not found in is_blk_device check {{(pid=86722) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 13:31:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:23 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd Jun 04 13:31:23 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-fb87a375-6fea-449d-b1ac-cf08f753440a req-7f7ea651-0288-43ac-899d-c2aca6b12385 tempest-TestServerVolumeAttachmentScenario-681105202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:29 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd" returned: 0 in 5.713s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:29 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd1f31c-ae3a-43f5-b7ec-692563a9ed45]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:29 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 Jun 04 13:31:29 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:30 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84" returned: 0 in 0.953s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:30 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:31:30 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Converted 1024.00 MB image at 179.21 MB/s Jun 04 13:31:30 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd is being set with open permissions: ugo+rw Jun 04 13:31:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:30 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd Jun 04 13:31:30 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:30 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=21,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:31:31 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd" returned: 0 in 0.654s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:31 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Lock "cinder-quobyte-2d3c0bc0-a279-4914-bc5c-c91a112e69cd" released by "_copy_volume_from_snapshot" :: held 8.983s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:31 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Acquiring lock "cinder-quobyte-26db17af-9cec-474a-aa04-8300300da193" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:31 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Lock "cinder-quobyte-26db17af-9cec-474a-aa04-8300300da193" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Deleting offline snapshot 26db17af-9cec-474a-aa04-8300300da193 of volume 9e76f531-3a3c-468c-88db-462038bc8c84 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:31:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] snapshot_file for this snap is: volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:31:31 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[57352c3b-d267-4a7a-a37f-b6e302d461d0]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:31 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 Jun 04 13:31:31 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:32 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193" returned: 0 in 0.798s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e76f531-3a3c-468c-88db-462038bc8c84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:31:32 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[29647664-e871-4731-8153-88fcf22d6af0]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:32 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 Jun 04 13:31:32 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:32 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84" returned: 0 in 0.787s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:32 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 Jun 04 13:31:32 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:33 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193" returned: 0 in 0.728s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:33 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193 Jun 04 13:31:33 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:34 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84.26db17af-9cec-474a-aa04-8300300da193" returned: 0 in 0.664s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Lock "cinder-quobyte-26db17af-9cec-474a-aa04-8300300da193" released by "_delete_snapshot" :: held 3.080s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.578s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-fb87a375-6fea-449d-b1ac-cf08f753440a req-7f7ea651-0288-43ac-899d-c2aca6b12385 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.925s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:34 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c718cfd-c4d3-4a5c-9c0d-31abf7626048]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-fb87a375-6fea-449d-b1ac-cf08f753440a req-7f7ea651-0288-43ac-899d-c2aca6b12385 tempest-TestServerVolumeAttachmentScenario-681105202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a7f6a1-81a2-4740-b7e5-a74596530b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd', 'volume_size': 2, 'source_volid': '9e76f531-3a3c-468c-88db-462038bc8c84', 'source_volstatus': 'available'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae661b16-aadf-42a1-86f2-4ff37a3bff3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:34 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Volume volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd (2d3c0bc0-a279-4914-bc5c-c91a112e69cd): created successfully Jun 04 13:31:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae661b16-aadf-42a1-86f2-4ff37a3bff3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:34 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Flow 'volume_create_manager' (b1516d5c-fc8a-45f5-b7e0-ad07f9485c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:31:34 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-3d93db5a-51fb-469b-8391-7fee6cffcad7 tempest-VolumesCloneTest-1789911339 None] Created volume successfully. Jun 04 13:31:34 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf Jun 04 13:31:34 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:35 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-fb87a375-6fea-449d-b1ac-cf08f753440a req-7f7ea651-0288-43ac-899d-c2aca6b12385 tempest-TestServerVolumeAttachmentScenario-681105202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf" returned: 0 in 0.843s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-fb87a375-6fea-449d-b1ac-cf08f753440a req-7f7ea651-0288-43ac-899d-c2aca6b12385 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.870s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-fb87a375-6fea-449d-b1ac-cf08f753440a req-7f7ea651-0288-43ac-899d-c2aca6b12385 tempest-TestServerVolumeAttachmentScenario-681105202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ff93b9a-c8ab-4c7e-aa06-639fee2f4d4b', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:31:35 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-fb87a375-6fea-449d-b1ac-cf08f753440a req-7f7ea651-0288-43ac-899d-c2aca6b12385 tempest-TestServerVolumeAttachmentScenario-681105202 None] attachment_update completed successfully. Jun 04 13:31:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Acquiring lock "cinder-2d3c0bc0-a279-4914-bc5c-c91a112e69cd-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Lock "cinder-2d3c0bc0-a279-4914-bc5c-c91a112e69cd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Acquiring lock "cinder-quobyte-2d3c0bc0-a279-4914-bc5c-c91a112e69cd" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Lock "cinder-quobyte-2d3c0bc0-a279-4914-bc5c-c91a112e69cd" acquired by "delete_volume" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:35 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[071a00d1-fbba-40aa-b847-89282ab7d7d8]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:35 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd Jun 04 13:31:35 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:36 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd" returned: 0 in 0.809s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:36 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd Jun 04 13:31:36 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:36 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2d3c0bc0-a279-4914-bc5c-c91a112e69cd" returned: 0 in 0.624s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Lock "cinder-quobyte-2d3c0bc0-a279-4914-bc5c-c91a112e69cd" released by "delete_volume" :: held 1.486s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Created reservations ['125264be-3aa4-4a00-885d-4801e7706199', '35ef01fe-2f17-4cfe-9471-30441e75949e', 'e5f20073-8fb3-4d78-a1a2-73ba85f55c9b', '3a3e3ee3-eb3d-4e7c-a132-b01a1c284c1f'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:37 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:31:37 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:37 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Acquiring lock "cinder-9e76f531-3a3c-468c-88db-462038bc8c84-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.631s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:31:37 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Deleted volume successfully. Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Lock "cinder-9e76f531-3a3c-468c-88db-462038bc8c84-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9157a148-8414-445e-b4c5-e72e62941bfe tempest-VolumesCloneTest-1789911339 None] Lock "cinder-2d3c0bc0-a279-4914-bc5c-c91a112e69cd-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Acquiring lock "cinder-quobyte-9e76f531-3a3c-468c-88db-462038bc8c84" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Lock "cinder-quobyte-9e76f531-3a3c-468c-88db-462038bc8c84" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[306dad4f-87ae-4650-b139-35857bf42eec]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:38 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 Jun 04 13:31:38 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:38 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84" returned: 0 in 0.733s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:38 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84 Jun 04 13:31:38 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:39 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-9e76f531-3a3c-468c-88db-462038bc8c84" returned: 0 in 0.665s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Lock "cinder-quobyte-9e76f531-3a3c-468c-88db-462038bc8c84" released by "delete_volume" :: held 1.482s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:39 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Created reservations ['59edb7ad-1935-4358-9a1a-a81d58ded854', 'f695e9a0-5131-44ce-b179-922c2720b421', '4403e126-5e0a-4394-8a90-8846b4f92163', 'e0dab88d-6694-453d-9c0a-4e8ef8a22fee'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:31:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:31:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:31:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:39 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:31:39 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:40 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.752s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:40 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:31:40 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Deleted volume successfully. Jun 04 13:31:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ea0056ee-9dc7-498b-b131-5272559f618b tempest-VolumesCloneTest-1789911339 None] Lock "cinder-9e76f531-3a3c-468c-88db-462038bc8c84-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:41 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-e348ac5e-a32d-4a69-9132-45d13dcf03b7 req-7986663b-7ad8-4274-8869-88da6281198a tempest-TestServerVolumeAttachmentScenario-681105202 None] Terminate volume connection completed successfully. Jun 04 13:31:41 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-e348ac5e-a32d-4a69-9132-45d13dcf03b7 req-7986663b-7ad8-4274-8869-88da6281198a tempest-TestServerVolumeAttachmentScenario-681105202 None] Deleting attachment 3ff93b9a-c8ab-4c7e-aa06-639fee2f4d4b. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:31:44 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:31:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Flow 'volume_create_manager' (012ee2c9-c3c8-4d49-9ad4-6d4156e0f99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:31:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61daab7b-d5b1-4578-ab20-a62f6ac62e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61daab7b-d5b1-4578-ab20-a62f6ac62e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1599226619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ed893f-536f-4770-81a7-2033987d3776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa8f828ed8e44419eecc797c225d6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:31:44Z,use_quota=True,user_id='db103ecd45e04167aedfc25afa596c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bbba39-9193-4c86-a57e-834e197b8492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bbba39-9193-4c86-a57e-834e197b8492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4eab72-46b1-4414-bfce-fec53aa66e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:44 devstack cinder-volume[86722]: DEBUG cinder.image.glance [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Creating Keystone auth plugin from conf {{(pid=86722) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 13:31:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4eab72-46b1-4414-bfce-fec53aa66e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85ed893f-536f-4770-81a7-2033987d3776', 'volume_name': 'volume-85ed893f-536f-4770-81a7-2033987d3776', 'volume_size': 1, 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6c11a9aab9d47a1bd95d90c20211b72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'created_at': datetime.datetime(2026, 6, 4, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc0e9de-db72-470d-8ae8-e8359681852e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecc0e9de-db72-470d-8ae8-e8359681852e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1888d5f5-124d-4c12-adf7-460f73d7489f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:45 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Volume 85ed893f-536f-4770-81a7-2033987d3776: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85ed893f-536f-4770-81a7-2033987d3776', 'volume_size': 1, 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6c11a9aab9d47a1bd95d90c20211b72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'created_at': datetime.datetime(2026, 6, 4, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 13:31:45 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Trying to clone 85ed893f-536f-4770-81a7-2033987d3776 from image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]). {{(pid=86722) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 13:31:45 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 13:31:45 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Image download 20.69 MB at 20.69 MB/s Jun 04 13:31:45 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[860dfbea-2b05-433e-a5d6-09d3d753142f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-06d2e2ba-76d8-40ca-8e87-4b64ee0cb376 req-21cedefb-2cc6-4bf6-af88-3a80926a6e56 tempest-TestServerVolumeAttachmentScenario-681105202 None] Terminate volume connection completed successfully. Jun 04 13:31:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-06d2e2ba-76d8-40ca-8e87-4b64ee0cb376 req-21cedefb-2cc6-4bf6-af88-3a80926a6e56 tempest-TestServerVolumeAttachmentScenario-681105202 None] Deleting attachment c7c7cb22-3af2-4f36-bea5-8bcef371ac53. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:31:45 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD Jun 04 13:31:45 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:46 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD" returned: 0 in 0.735s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:46 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Temporary image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d is fetched for user db103ecd45e04167aedfc25afa596c4c. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 13:31:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05cc147-61c1-4ece-94c9-fff87f6240c4]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:46 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD Jun 04 13:31:46 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:47 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD" returned: 0 in 0.692s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1599226619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ed893f-536f-4770-81a7-2033987d3776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa8f828ed8e44419eecc797c225d6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:31:44Z,use_quota=True,user_id='db103ecd45e04167aedfc25afa596c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:31:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Creating volume 85ed893f-536f-4770-81a7-2033987d3776 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:31:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:31:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:31:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:31:47 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:31:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:47 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 1073741824 Jun 04 13:31:47 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:48 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 1073741824" returned: 0 in 0.925s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:48 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 Jun 04 13:31:48 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:48 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776" returned: 0 in 0.711s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:31:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:48 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Attempting download of 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d ((None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}])) to volume 85ed893f-536f-4770-81a7-2033987d3776. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 13:31:48 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[950e65d7-33fa-412c-b5e3-a72841afa2a9]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_n3pwmxhc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:49 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_n3pwmxhc Jun 04 13:31:49 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:49 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_n3pwmxhc" returned: 0 in 0.783s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_n3pwmxhc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:49 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_n3pwmxhc Jun 04 13:31:49 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:50 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_n3pwmxhc" returned: 1 in 0.735s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_n3pwmxhc' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:31:50 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff0db4b-2ed7-49b5-adb3-f345669e2041]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:50 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD Jun 04 13:31:50 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:51 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD" returned: 0 in 0.835s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:51 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d was qcow2, converting to raw {{(pid=86722) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 13:31:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:51 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 Jun 04 13:31:51 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:53 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776" returned: 0 in 2.375s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:53 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_8g0yit_adevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:31:53 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Converted 112.00 MB image at 47.13 MB/s Jun 04 13:31:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:53 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 1G Jun 04 13:31:53 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:54 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 1G" returned: 0 in 0.714s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:54 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[589f702b-ce8a-4bca-9531-2c76e95504b0]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:54 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 Jun 04 13:31:54 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:55 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776" returned: 0 in 0.766s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:55 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 Jun 04 13:31:55 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:56 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776" returned: 1 in 0.837s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Downloaded image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d ((None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}])) to volume 85ed893f-536f-4770-81a7-2033987d3776 successfully. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Temporary image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d for user db103ecd45e04167aedfc25afa596c4c is deleted. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Marking volume 85ed893f-536f-4770-81a7-2033987d3776 as bootable. {{(pid=86722) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Copying metadata from image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d to 85ed893f-536f-4770-81a7-2033987d3776. {{(pid=86722) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Creating volume glance metadata for volume 85ed893f-536f-4770-81a7-2033987d3776 backed by image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86722) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1888d5f5-124d-4c12-adf7-460f73d7489f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ed893f-536f-4770-81a7-2033987d3776', 'volume_size': 1, 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6c11a9aab9d47a1bd95d90c20211b72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'created_at': datetime.datetime(2026, 6, 4, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba55a99c-dec1-45f2-a561-7c55843916b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:56 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Volume volume-85ed893f-536f-4770-81a7-2033987d3776 (85ed893f-536f-4770-81a7-2033987d3776): created successfully Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba55a99c-dec1-45f2-a561-7c55843916b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Flow 'volume_create_manager' (012ee2c9-c3c8-4d49-9ad4-6d4156e0f99c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:31:56 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d974c5a7-f5a7-4c16-8a32-b40a471b7738 tempest-VolumesExtendTest-1467773184 None] Created volume successfully. Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Acquiring lock "cinder-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "cinder-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Acquiring lock "cinder-quobyte-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "cinder-quobyte-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-28cdab30-ed53-4197-8651-5990d634d453 tempest-VolumesExtendTest-1467773184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-28cdab30-ed53-4197-8651-5990d634d453 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3a9b62-4f37-47f5-89df-21761ea3eee9]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff366b2-f375-44e5-9c1f-a2367535b885]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-28cdab30-ed53-4197-8651-5990d634d453 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:56 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf Jun 04 13:31:56 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:56 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 Jun 04 13:31:56 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:57 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf" returned: 0 in 0.798s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:57 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-28cdab30-ed53-4197-8651-5990d634d453 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776" returned: 0 in 0.764s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-28cdab30-ed53-4197-8651-5990d634d453 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:57 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf Jun 04 13:31:57 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:57 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 Jun 04 13:31:57 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:58 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf" returned: 0 in 0.686s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "cinder-quobyte-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf" released by "delete_volume" :: held 1.544s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Created reservations ['5408209a-0bd8-44a5-bf39-65d6f654b74e', 'dcf3458f-873d-45fb-9131-ff32cf249209', 'cda6fdc5-b25c-429b-a087-3589f6dcb33a', 'c7eee96f-650b-49cd-86b6-e03f0cc571c2'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:31:58 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-28cdab30-ed53-4197-8651-5990d634d453 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776" returned: 1 in 0.760s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-28cdab30-ed53-4197-8651-5990d634d453 tempest-VolumesExtendTest-1467773184 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-28cdab30-ed53-4197-8651-5990d634d453 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 2G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-28cdab30-ed53-4197-8651-5990d634d453 tempest-VolumesExtendTest-1467773184 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 2G" returned: 0 in 0.097s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-28cdab30-ed53-4197-8651-5990d634d453 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.691s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:31:58 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:31:58 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:58 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-28cdab30-ed53-4197-8651-5990d634d453 tempest-VolumesExtendTest-1467773184 None] Extend volume completed successfully. Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Acquiring lock "cinder-4f26273e-bd37-4944-be4b-5b9777742a7e-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "cinder-4f26273e-bd37-4944-be4b-5b9777742a7e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Acquiring lock "cinder-quobyte-4f26273e-bd37-4944-be4b-5b9777742a7e" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "cinder-quobyte-4f26273e-bd37-4944-be4b-5b9777742a7e" acquired by "delete_volume" :: waited 0.020s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[1806b08b-4293-494d-a4e3-8c776a6060bc]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:58 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.635s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:31:58 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Deleted volume successfully. Jun 04 13:31:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7be5dd48-4f74-4bf8-9a2e-04b26994a053 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "cinder-4f0a1b5f-d121-4708-bd74-eaa034d9f2cf-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:31:59 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e Jun 04 13:31:59 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Acquiring lock "cinder-85ed893f-536f-4770-81a7-2033987d3776-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Lock "cinder-85ed893f-536f-4770-81a7-2033987d3776-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Acquiring lock "cinder-quobyte-85ed893f-536f-4770-81a7-2033987d3776" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Lock "cinder-quobyte-85ed893f-536f-4770-81a7-2033987d3776" acquired by "delete_volume" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3424dc4f-49ad-4c62-861b-bd81d89c2bf4]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:59 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 Jun 04 13:31:59 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:59 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e" returned: 0 in 0.781s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:31:59 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e Jun 04 13:31:59 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Flow 'volume_create_manager' (c68c4453-6080-498f-b697-053e8376bbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bcfce5-6fd9-4814-98e3-78c638b8c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bcfce5-6fd9-4814-98e3-78c638b8c87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-468600401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384fcfff-6e74-4927-8a2d-11edc9c2b0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a5981de77b4b16bfe1b96d249ec782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:32:00Z,use_quota=True,user_id='ecd798a9c9f440cb9b55611124fffadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db70755-64d7-49b6-b560-469ae03ad7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db70755-64d7-49b6-b560-469ae03ad7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537750dc-92a6-47ac-b929-6c586241b7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:31:59 devstack cinder-volume[86722]: DEBUG cinder.image.glance [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Creating Keystone auth plugin from conf {{(pid=86722) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 13:32:00 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776" returned: 0 in 0.767s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:00 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 Jun 04 13:32:00 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537750dc-92a6-47ac-b929-6c586241b7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '384fcfff-6e74-4927-8a2d-11edc9c2b0ff', 'volume_name': 'volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff', 'volume_size': 1, 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6c11a9aab9d47a1bd95d90c20211b72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'created_at': datetime.datetime(2026, 6, 4, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a187af-0f8a-48e6-9679-118d00ff0e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a187af-0f8a-48e6-9679-118d00ff0e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a9adc3-fe73-4ebc-8838-be7ed514da9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:00 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Volume 384fcfff-6e74-4927-8a2d-11edc9c2b0ff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff', 'volume_size': 1, 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6c11a9aab9d47a1bd95d90c20211b72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'created_at': datetime.datetime(2026, 6, 4, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Trying to clone 384fcfff-6e74-4927-8a2d-11edc9c2b0ff from image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]). {{(pid=86722) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 13:32:00 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-4f26273e-bd37-4944-be4b-5b9777742a7e" returned: 0 in 0.662s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "cinder-quobyte-4f26273e-bd37-4944-be4b-5b9777742a7e" released by "delete_volume" :: held 1.523s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Created reservations ['c1955ea8-ff56-45c1-bb8a-e6c2231ca1a0', 'dbcd305a-2ef2-4909-b7a8-4cb8f8a78306', 'edd8c1a3-1dc6-497f-abbe-1c08c87cf5cc', '46358329-c848-44b7-9658-aa5ef0c3cd03'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 13:32:00 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Image download 20.69 MB at 20.69 MB/s Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9874fc64-1da8-4998-ab65-0d53086ec316]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:00 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:32:00 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:00 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD Jun 04 13:32:00 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:00 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776" returned: 1 in 0.782s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:32:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:00 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776 Jun 04 13:32:00 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:01 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.774s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:32:01 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD" returned: 0 in 0.767s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Temporary image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d is fetched for user ecd798a9c9f440cb9b55611124fffadc. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 13:32:01 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Deleted volume successfully. Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b7849e92-9667-4289-829a-ec82ff863121 tempest-TestServerVolumeAttachmentScenario-681105202 None] Lock "cinder-4f26273e-bd37-4944-be4b-5b9777742a7e-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01922e8-2d2b-4315-897b-eb54260aa035]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:01 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-85ed893f-536f-4770-81a7-2033987d3776" returned: 0 in 0.849s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Lock "cinder-quobyte-85ed893f-536f-4770-81a7-2033987d3776" released by "delete_volume" :: held 2.482s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:32:01 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD Jun 04 13:32:01 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Created reservations ['07879ea5-8965-49f2-901d-29a780e3c6c3', '8c19c289-d4cc-4a70-8881-bb9abe972422', 'd86d516b-8e32-4156-afd1-c14423bda529', '9a6d7bf3-a1ed-4bf5-a0b7-4ac87f5e2cea'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:01 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:32:01 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:02 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD" returned: 0 in 0.724s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-468600401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384fcfff-6e74-4927-8a2d-11edc9c2b0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71a5981de77b4b16bfe1b96d249ec782',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:32:00Z,use_quota=True,user_id='ecd798a9c9f440cb9b55611124fffadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Creating volume 384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:32:02 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:02 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff 1073741824 Jun 04 13:32:02 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:02 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.681s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:32:02 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Deleted volume successfully. Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f1573151-d078-44a0-b5a1-93ceb94fa996 tempest-VolumesExtendTest-1467773184 None] Lock "cinder-85ed893f-536f-4770-81a7-2033987d3776-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:32:02 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Flow 'volume_create_manager' (ddcca63d-51e6-44a8-838d-af1446a5bb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a624920a-f448-4bbf-83fc-39e468a683d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a624920a-f448-4bbf-83fc-39e468a683d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1982548377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028479ff-54a2-42cc-9167-5a8637f6bef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa8f828ed8e44419eecc797c225d6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:32:03Z,use_quota=True,user_id='db103ecd45e04167aedfc25afa596c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89c51f2-1c85-4cf7-88fd-03f58817e83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89c51f2-1c85-4cf7-88fd-03f58817e83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33ccfbe-a816-44c9-909a-22cc9120159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33ccfbe-a816-44c9-909a-22cc9120159c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '028479ff-54a2-42cc-9167-5a8637f6bef7', 'volume_name': 'volume-028479ff-54a2-42cc-9167-5a8637f6bef7', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a41b14-8ed2-4d91-8755-67ac5370ee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a41b14-8ed2-4d91-8755-67ac5370ee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0250d7-a679-4340-9874-44484c0868b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:03 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Volume 028479ff-54a2-42cc-9167-5a8637f6bef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-028479ff-54a2-42cc-9167-5a8637f6bef7', 'volume_size': 1} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:03 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff 1073741824" returned: 0 in 0.950s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:03 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff Jun 04 13:32:03 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:03 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" returned: 0 in 0.683s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.909s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1982548377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028479ff-54a2-42cc-9167-5a8637f6bef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fa8f828ed8e44419eecc797c225d6c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:32:03Z,use_quota=True,user_id='db103ecd45e04167aedfc25afa596c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Creating volume 028479ff-54a2-42cc-9167-5a8637f6bef7 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:32:03 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:32:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:04 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 1073741824 Jun 04 13:32:04 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Attempting download of 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d ((None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}])) to volume 384fcfff-6e74-4927-8a2d-11edc9c2b0ff. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:04 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:32:04 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc59b1e-1df9-4e91-88de-b4e6ec644978]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_mvz_erjc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:04 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_mvz_erjc Jun 04 13:32:04 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:04 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.759s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:32:04 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_mvz_erjc" returned: 0 in 0.839s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_mvz_erjc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:05 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 1073741824" returned: 0 in 1.034s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:05 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 Jun 04 13:32:05 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:05 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_mvz_erjc Jun 04 13:32:05 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:05 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_mvz_erjc" returned: 1 in 0.745s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_mvz_erjc' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc46762e-8216-4b9b-927b-60942a2d1b4f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:05 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7" returned: 0 in 0.687s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0250d7-a679-4340-9874-44484c0868b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028479ff-54a2-42cc-9167-5a8637f6bef7', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dec0bcf-eded-4df7-9764-50ac36b79207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=72,cinder:SELECT=76,cinder:INSERT=24,cinder:DELETE=5 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:32:05 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Volume volume-028479ff-54a2-42cc-9167-5a8637f6bef7 (028479ff-54a2-42cc-9167-5a8637f6bef7): created successfully Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dec0bcf-eded-4df7-9764-50ac36b79207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Flow 'volume_create_manager' (ddcca63d-51e6-44a8-838d-af1446a5bb1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:32:05 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8617df9a-ecfe-46ff-9a7e-02165eaf5222 tempest-VolumesExtendTest-1467773184 None] Created volume successfully. Jun 04 13:32:05 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD Jun 04 13:32:05 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] Creating offline snapshot 7c0ab6ee-e5fc-424b-955a-415b0d64c52f of volume 028479ff-54a2-42cc-9167-5a8637f6bef7 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:32:06 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f27a21-948f-4947-b669-47921340b219]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:06 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:06 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d was qcow2, converting to raw {{(pid=86722) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 13:32:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:06 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff Jun 04 13:32:06 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:06 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 Jun 04 13:32:06 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:07 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7" returned: 0 in 0.804s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:07 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f 1G Jun 04 13:32:07 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:08 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f 1G" returned: 0 in 0.898s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-028479ff-54a2-42cc-9167-5a8637f6bef7 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:08 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-028479ff-54a2-42cc-9167-5a8637f6bef7 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f Jun 04 13:32:08 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:08 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" returned: 0 in 2.182s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:08 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d418b88-1e3b-4b6d-b0ff-110188dd4e7d_m5sk2b7ndevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:32:08 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Converted 112.00 MB image at 51.29 MB/s Jun 04 13:32:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:08 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff 1G Jun 04 13:32:08 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:08 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-028479ff-54a2-42cc-9167-5a8637f6bef7 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f" returned: 0 in 0.869s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:09 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f is being set with open permissions: ugo+rw Jun 04 13:32:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:09 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f Jun 04 13:32:09 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:09 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff 1G" returned: 0 in 0.734s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:09 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8891002-62fc-4e2a-a631-63a2c056dd5e]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:09 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff Jun 04 13:32:09 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:09 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f" returned: 0 in 0.628s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:09 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.info Jun 04 13:32:09 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:10 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" returned: 0 in 0.764s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:10 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.info" returned: 0 in 0.682s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:10 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.info is being set with open permissions: ugo+rw Jun 04 13:32:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:10 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.info Jun 04 13:32:10 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:10 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff Jun 04 13:32:10 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:10 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" returned: 1 in 0.742s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Downloaded image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d ((None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}])) to volume 384fcfff-6e74-4927-8a2d-11edc9c2b0ff successfully. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Temporary image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d for user ecd798a9c9f440cb9b55611124fffadc is deleted. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Marking volume 384fcfff-6e74-4927-8a2d-11edc9c2b0ff as bootable. {{(pid=86722) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 13:32:11 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.info" returned: 0 in 0.671s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.653s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Copying metadata from image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d to 384fcfff-6e74-4927-8a2d-11edc9c2b0ff. {{(pid=86722) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Creating volume glance metadata for volume 384fcfff-6e74-4927-8a2d-11edc9c2b0ff backed by image 2d418b88-1e3b-4b6d-b0ff-110188dd4e7d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86722) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 13:32:11 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fffcd470-0c7f-4f24-9d4a-b561bc3d5feb tempest-VolumesExtendTest-1467773184 None] Create snapshot completed successfully Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a9adc3-fe73-4ebc-8838-be7ed514da9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff', 'volume_size': 1, 'image_id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e6c11a9aab9d47a1bd95d90c20211b72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d418b88-1e3b-4b6d-b0ff-110188dd4e7d', 'created_at': datetime.datetime(2026, 6, 4, 11, 9, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 9, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d418b88-1e3b-4b6d-b0ff-110188dd4e7d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805348b3-b9ac-444a-beef-d427d7ebc1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:11 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Volume volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff (384fcfff-6e74-4927-8a2d-11edc9c2b0ff): created successfully Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805348b3-b9ac-444a-beef-d427d7ebc1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Flow 'volume_create_manager' (c68c4453-6080-498f-b697-053e8376bbfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:32:11 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a06d4b56-c713-4438-9979-87dbe150f5db tempest-TestShelveInstance-1652418693 None] Created volume successfully. Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e655da13-7247-4cba-a8af-ce05efa0ffd5 tempest-VolumesExtendTest-1467773184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e655da13-7247-4cba-a8af-ce05efa0ffd5 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[089675c2-3402-4b49-9ffd-1e759e9dd5f5]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e655da13-7247-4cba-a8af-ce05efa0ffd5 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:11 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 Jun 04 13:32:11 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:12 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e655da13-7247-4cba-a8af-ce05efa0ffd5 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7" returned: 0 in 0.820s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e655da13-7247-4cba-a8af-ce05efa0ffd5 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f 2G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e655da13-7247-4cba-a8af-ce05efa0ffd5 tempest-VolumesExtendTest-1467773184 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f 2G" returned: 0 in 0.196s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e655da13-7247-4cba-a8af-ce05efa0ffd5 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.056s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:12 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e655da13-7247-4cba-a8af-ce05efa0ffd5 tempest-VolumesExtendTest-1467773184 None] Extend volume completed successfully. Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Acquiring lock "cinder-7c0ab6ee-e5fc-424b-955a-415b0d64c52f-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Lock "cinder-7c0ab6ee-e5fc-424b-955a-415b0d64c52f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Acquiring lock "cinder-quobyte-028479ff-54a2-42cc-9167-5a8637f6bef7" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Lock "cinder-quobyte-028479ff-54a2-42cc-9167-5a8637f6bef7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Acquiring lock "cinder-quobyte-7c0ab6ee-e5fc-424b-955a-415b0d64c52f" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Lock "cinder-quobyte-7c0ab6ee-e5fc-424b-955a-415b0d64c52f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Deleting offline snapshot 7c0ab6ee-e5fc-424b-955a-415b0d64c52f of volume 028479ff-54a2-42cc-9167-5a8637f6bef7 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] snapshot_file for this snap is: volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18a046e-5b7a-4b41-b8ff-eae2c993998a]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:14 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f Jun 04 13:32:14 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:14 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f" returned: 0 in 0.720s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-028479ff-54a2-42cc-9167-5a8637f6bef7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53c8d17-98ef-4571-bc47-5c606240be29]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:15 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 Jun 04 13:32:15 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:15 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7" returned: 0 in 0.732s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:15 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f Jun 04 13:32:15 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:16 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f" returned: 0 in 0.889s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:16 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f Jun 04 13:32:16 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:17 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7.7c0ab6ee-e5fc-424b-955a-415b0d64c52f" returned: 0 in 0.646s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Lock "cinder-quobyte-7c0ab6ee-e5fc-424b-955a-415b0d64c52f" released by "_delete_snapshot" :: held 3.140s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:32:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Lock "cinder-quobyte-028479ff-54a2-42cc-9167-5a8637f6bef7" released by "delete_snapshot" :: held 3.166s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:32:17 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Created reservations ['a628846e-e03e-4db2-ad8b-0f833ce7217a', '71b4a7ab-6c85-4c79-bd2b-bcad4be27370', '036eff4f-2930-4f42-ba96-7c0547886632', 'aaeae8d8-bace-47c9-800f-e82816ee06e5'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:32:17 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Delete snapshot completed successfully. Jun 04 13:32:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c6437286-67b3-4cb1-9f9b-3507256f3d0e tempest-VolumesExtendTest-1467773184 None] Lock "cinder-7c0ab6ee-e5fc-424b-955a-415b0d64c52f-delete_snapshot" released by "delete_snapshot" :: held 3.358s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:32:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Acquiring lock "cinder-028479ff-54a2-42cc-9167-5a8637f6bef7-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:32:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Lock "cinder-028479ff-54a2-42cc-9167-5a8637f6bef7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:32:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Acquiring lock "cinder-quobyte-028479ff-54a2-42cc-9167-5a8637f6bef7" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:32:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Lock "cinder-quobyte-028479ff-54a2-42cc-9167-5a8637f6bef7" acquired by "delete_volume" :: waited 0.026s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:32:18 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[299cb79b-c890-41ff-9b4a-47f8bb4fa711]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:18 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 Jun 04 13:32:18 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a79da428-df9c-47f8-8f16-4e473b63aa23 req-a89859d4-167b-41c6-b327-6497fea0201f tempest-TestShelveInstance-1652418693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a79da428-df9c-47f8-8f16-4e473b63aa23 req-a89859d4-167b-41c6-b327-6497fea0201f tempest-TestShelveInstance-1652418693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:19 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[052322a7-9741-467e-a153-5f14963d45d5]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a79da428-df9c-47f8-8f16-4e473b63aa23 req-a89859d4-167b-41c6-b327-6497fea0201f tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:19 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff Jun 04 13:32:19 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:19 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7" returned: 0 in 0.936s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:19 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7 Jun 04 13:32:19 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:20 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a79da428-df9c-47f8-8f16-4e473b63aa23 req-a89859d4-167b-41c6-b327-6497fea0201f tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" returned: 0 in 1.047s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a79da428-df9c-47f8-8f16-4e473b63aa23 req-a89859d4-167b-41c6-b327-6497fea0201f tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:20 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff Jun 04 13:32:20 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:20 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-028479ff-54a2-42cc-9167-5a8637f6bef7" returned: 0 in 1.158s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Lock "cinder-quobyte-028479ff-54a2-42cc-9167-5a8637f6bef7" released by "delete_volume" :: held 2.194s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:32:20 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Created reservations ['1ac2d58c-6b92-4d56-b79c-424588c0a479', '184a96ce-bb21-4eea-93a1-9bbc9e644f64', '8008cfe0-d292-4c0e-b84c-410e45ef6643', '54654d96-9485-4d6d-9fbe-cdd897d04044'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:32:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:32:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:32:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:21 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:32:21 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:21 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a79da428-df9c-47f8-8f16-4e473b63aa23 req-a89859d4-167b-41c6-b327-6497fea0201f tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" returned: 1 in 1.062s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-a79da428-df9c-47f8-8f16-4e473b63aa23 req-a89859d4-167b-41c6-b327-6497fea0201f tempest-TestShelveInstance-1652418693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:32:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-a79da428-df9c-47f8-8f16-4e473b63aa23 req-a89859d4-167b-41c6-b327-6497fea0201f tempest-TestShelveInstance-1652418693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.183s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-a79da428-df9c-47f8-8f16-4e473b63aa23 req-a89859d4-167b-41c6-b327-6497fea0201f tempest-TestShelveInstance-1652418693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69e59041-797c-4496-906c-a85de9923cfc', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:32:21 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-a79da428-df9c-47f8-8f16-4e473b63aa23 req-a89859d4-167b-41c6-b327-6497fea0201f tempest-TestShelveInstance-1652418693 None] attachment_update completed successfully. Jun 04 13:32:21 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.801s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:21 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:32:21 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Deleted volume successfully. Jun 04 13:32:21 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-205ddd4b-ae04-49b9-a932-a267df7a28d7 tempest-VolumesExtendTest-1467773184 None] Lock "cinder-028479ff-54a2-42cc-9167-5a8637f6bef7-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:32:31 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=24,cinder:SELECT=26,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:32:31 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=77,cinder:SELECT=78,cinder:INSERT=30,cinder:DELETE=4 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Flow 'volume_create_manager' (3483358d-2c1a-4178-9735-465721be993c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fccdfee3-e959-49c0-88fc-17f20aaa1757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fccdfee3-e959-49c0-88fc-17f20aaa1757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1898004710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944c0ffe-506b-4cdc-842f-2d213320cd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3eedb182054f71a853f4fd60b2181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:32:33Z,use_quota=True,user_id='fd13796d9e87459293cd80c068dd4b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60d4bb0-fb0f-467c-8cd6-25f74ed5c45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60d4bb0-fb0f-467c-8cd6-25f74ed5c45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf8ac09-010d-41de-90b9-5d86be0010e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf8ac09-010d-41de-90b9-5d86be0010e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944c0ffe-506b-4cdc-842f-2d213320cd13', 'volume_name': 'volume-944c0ffe-506b-4cdc-842f-2d213320cd13', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6768d2aa-7cb1-48ce-97f4-0383f832983d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6768d2aa-7cb1-48ce-97f4-0383f832983d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c103fd3-69e5-45eb-b15b-4196a0347c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:33 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Volume 944c0ffe-506b-4cdc-842f-2d213320cd13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944c0ffe-506b-4cdc-842f-2d213320cd13', 'volume_size': 1} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1898004710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944c0ffe-506b-4cdc-842f-2d213320cd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3eedb182054f71a853f4fd60b2181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:32:33Z,use_quota=True,user_id='fd13796d9e87459293cd80c068dd4b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Creating volume 944c0ffe-506b-4cdc-842f-2d213320cd13 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:32:33 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:32:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:33 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 1073741824 Jun 04 13:32:33 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 1073741824" returned: 0 in 1.295s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:34 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:34 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 Jun 04 13:32:34 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:35 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13" returned: 0 in 0.870s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] <== create_volume: return (2232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:32:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c103fd3-69e5-45eb-b15b-4196a0347c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944c0ffe-506b-4cdc-842f-2d213320cd13', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3fc5f6-6120-4b0d-beb6-2c58211aab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:35 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Volume volume-944c0ffe-506b-4cdc-842f-2d213320cd13 (944c0ffe-506b-4cdc-842f-2d213320cd13): created successfully Jun 04 13:32:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3fc5f6-6120-4b0d-beb6-2c58211aab47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Flow 'volume_create_manager' (3483358d-2c1a-4178-9735-465721be993c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:32:35 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-3f2fa6ce-e9b4-4b8d-abf9-6c450f41537a tempest-TestStampPattern-1763623516 None] Created volume successfully. Jun 04 13:32:42 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:32:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Flow 'volume_create_manager' (7bc08d95-c9ef-4cde-9564-e86892b0e43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:32:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab0d6fc-5581-4aa7-ab57-77359deb1574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab0d6fc-5581-4aa7-ab57-77359deb1574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2111714255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a416972b-d9c9-4368-be78-6f87d89e56ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5824d4185db4a42b74f3e16365c159e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:32:43Z,use_quota=True,user_id='b30694fedb28497a919c0abfc19c1293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59abe5ec-5c01-47d7-90d1-b9733321678e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59abe5ec-5c01-47d7-90d1-b9733321678e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42cfdee6-a628-4b0a-9ef5-2fc182afe3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:42 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42cfdee6-a628-4b0a-9ef5-2fc182afe3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a416972b-d9c9-4368-be78-6f87d89e56ac', 'volume_name': 'volume-a416972b-d9c9-4368-be78-6f87d89e56ac', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0db58ba-c867-4f34-a90f-89644d0d9e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0db58ba-c867-4f34-a90f-89644d0d9e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67007bf-aa61-42c8-b708-43301abce644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:43 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Volume a416972b-d9c9-4368-be78-6f87d89e56ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a416972b-d9c9-4368-be78-6f87d89e56ac', 'volume_size': 1} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2111714255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a416972b-d9c9-4368-be78-6f87d89e56ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5824d4185db4a42b74f3e16365c159e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:32:43Z,use_quota=True,user_id='b30694fedb28497a919c0abfc19c1293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Creating volume a416972b-d9c9-4368-be78-6f87d89e56ac {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:32:43 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:32:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:43 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac 1073741824 Jun 04 13:32:43 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:44 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac 1073741824" returned: 0 in 1.035s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:44 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac Jun 04 13:32:44 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:44 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac" returned: 0 in 0.772s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:32:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67007bf-aa61-42c8-b708-43301abce644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a416972b-d9c9-4368-be78-6f87d89e56ac', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069c40e8-66f8-4826-b01e-75a3cda95b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:44 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Volume volume-a416972b-d9c9-4368-be78-6f87d89e56ac (a416972b-d9c9-4368-be78-6f87d89e56ac): created successfully Jun 04 13:32:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069c40e8-66f8-4826-b01e-75a3cda95b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Flow 'volume_create_manager' (7bc08d95-c9ef-4cde-9564-e86892b0e43e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:32:44 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-4ff4bafa-99b6-48bf-819f-2ea37fe37fa0 tempest-VolumesSnapshotTestJSON-953008577 None] Created volume successfully. Jun 04 13:32:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] Creating offline snapshot 3519062b-be06-4f0e-80b9-70b34264045b of volume a416972b-d9c9-4368-be78-6f87d89e56ac {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:32:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8324ea-1df5-4e7e-8210-a1ca93e3ce50]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:46 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac Jun 04 13:32:46 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:46 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac" returned: 0 in 0.752s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:47 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b 1G Jun 04 13:32:47 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:47 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b 1G" returned: 0 in 0.771s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a416972b-d9c9-4368-be78-6f87d89e56ac -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:47 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a416972b-d9c9-4368-be78-6f87d89e56ac -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b Jun 04 13:32:47 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:48 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a416972b-d9c9-4368-be78-6f87d89e56ac -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b" returned: 0 in 0.698s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:48 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b is being set with open permissions: ugo+rw Jun 04 13:32:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:48 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b Jun 04 13:32:48 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:49 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b" returned: 0 in 0.803s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:49 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.info Jun 04 13:32:49 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:50 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.info" returned: 0 in 1.108s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:50 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.info is being set with open permissions: ugo+rw Jun 04 13:32:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:50 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.info Jun 04 13:32:50 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:51 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.info" returned: 0 in 1.180s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.447s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c62fe263-8350-4374-891c-145c0b4f5598 tempest-VolumesSnapshotTestJSON-953008577 None] Create snapshot completed successfully Jun 04 13:32:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-3519062b-be06-4f0e-80b9-70b34264045b-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:32:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-3519062b-be06-4f0e-80b9-70b34264045b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:32:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-a416972b-d9c9-4368-be78-6f87d89e56ac" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:32:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-a416972b-d9c9-4368-be78-6f87d89e56ac" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:32:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-3519062b-be06-4f0e-80b9-70b34264045b" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:32:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-3519062b-be06-4f0e-80b9-70b34264045b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:32:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Deleting offline snapshot 3519062b-be06-4f0e-80b9-70b34264045b of volume a416972b-d9c9-4368-be78-6f87d89e56ac {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:32:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] snapshot_file for this snap is: volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:32:52 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[78be8706-4363-469a-a5a5-40a56d0b2eef]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:52 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b Jun 04 13:32:52 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:53 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b" returned: 0 in 0.849s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a416972b-d9c9-4368-be78-6f87d89e56ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:32:53 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3f761b-0084-4f71-b7db-0487a6f6ee0d]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:53 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac Jun 04 13:32:53 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:54 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac" returned: 0 in 0.779s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:54 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b Jun 04 13:32:54 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:55 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b" returned: 0 in 0.668s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:55 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b Jun 04 13:32:55 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:55 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac.3519062b-be06-4f0e-80b9-70b34264045b" returned: 0 in 0.763s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-3519062b-be06-4f0e-80b9-70b34264045b" released by "_delete_snapshot" :: held 3.180s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:32:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-a416972b-d9c9-4368-be78-6f87d89e56ac" released by "delete_snapshot" :: held 3.204s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:32:56 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Created reservations ['10fbaddc-cc06-458f-89cb-b4917f4a9405', '6ea4fba7-05d7-499a-a1c6-0ee71270a405', '3b4dc149-ee18-4fa5-bb2f-c1804c446190', '8d051ca8-f088-47c5-97bf-773a11bd58f3'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:32:56 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Delete snapshot completed successfully. Jun 04 13:32:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7d92f621-bf3a-4a1e-b2c4-9de1b27a3505 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-3519062b-be06-4f0e-80b9-70b34264045b-delete_snapshot" released by "delete_snapshot" :: held 3.414s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Flow 'volume_create_manager' (c2e3ad70-1d27-4053-90c5-7dee4adf4549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369c020e-6ef0-4fc2-8fb2-349bd480a07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369c020e-6ef0-4fc2-8fb2-349bd480a07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-436805678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b8f18e-cdf1-4240-97e2-d4bdd25319a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5824d4185db4a42b74f3e16365c159e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:32:58Z,use_quota=True,user_id='b30694fedb28497a919c0abfc19c1293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88ed65a-17b5-466e-b423-f4fef1a47226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88ed65a-17b5-466e-b423-f4fef1a47226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84722861-f601-4e29-83d7-70197b355202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84722861-f601-4e29-83d7-70197b355202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b8f18e-cdf1-4240-97e2-d4bdd25319a9', 'volume_name': 'volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91964954-1e65-4bac-90b5-84d0d8149cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91964954-1e65-4bac-90b5-84d0d8149cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac45e988-75d3-4906-9fee-106cea936874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:57 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Volume c1b8f18e-cdf1-4240-97e2-d4bdd25319a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9', 'volume_size': 1} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:32:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-436805678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b8f18e-cdf1-4240-97e2-d4bdd25319a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5824d4185db4a42b74f3e16365c159e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:32:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:32:58Z,use_quota=True,user_id='b30694fedb28497a919c0abfc19c1293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Creating volume c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:32:57 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:32:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:57 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 1073741824 Jun 04 13:32:57 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:58 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 1073741824" returned: 0 in 0.907s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:32:58 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 Jun 04 13:32:58 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:32:59 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jun 04 13:32:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" returned: 0 in 0.632s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:32:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:32:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:32:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac45e988-75d3-4906-9fee-106cea936874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86aa3629-64d2-4a75-be3d-6f920ff25249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:32:59 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Volume volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 (c1b8f18e-cdf1-4240-97e2-d4bdd25319a9): created successfully Jun 04 13:32:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86aa3629-64d2-4a75-be3d-6f920ff25249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:32:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Flow 'volume_create_manager' (c2e3ad70-1d27-4053-90c5-7dee4adf4549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:32:59 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c7f0d9f9-f467-478a-a75c-6e3778050eb7 tempest-VolumesSnapshotTestJSON-953008577 None] Created volume successfully. Jun 04 13:32:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:32:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:32:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] Creating offline snapshot 75553c18-a2ca-4ee8-b563-1f874a9c501a of volume c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:32:59 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[7368bcfe-3378-445b-ae91-39b95e34fe23]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:32:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:00 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 Jun 04 13:33:00 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:00 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" returned: 0 in 0.742s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:00 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a 1G Jun 04 13:33:00 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:01 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a 1G" returned: 0 in 0.755s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:01 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a Jun 04 13:33:01 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:02 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a" returned: 0 in 0.655s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:02 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a is being set with open permissions: ugo+rw Jun 04 13:33:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:02 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a Jun 04 13:33:02 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:02 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a" returned: 0 in 0.592s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:02 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.info Jun 04 13:33:02 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:03 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.info" returned: 0 in 0.661s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:03 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.info is being set with open permissions: ugo+rw Jun 04 13:33:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:03 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.info Jun 04 13:33:03 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:33:04 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.info" returned: 0 in 0.708s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:04 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:33:04 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.204s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:04 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-7c027f75-9731-4ff8-83cc-68999f8eed43 tempest-VolumesSnapshotTestJSON-953008577 None] Create snapshot completed successfully Jun 04 13:33:04 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.616s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:33:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Flow 'volume_create_manager' (6b62d355-bdcf-4325-a6ee-76f4e6ff72d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48bf48bf-4790-429c-946b-9d2c729a5969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48bf48bf-4790-429c-946b-9d2c729a5969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1576608836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eff7e15-8356-4d1b-9608-ea68ca27b48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5824d4185db4a42b74f3e16365c159e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:33:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=75553c18-a2ca-4ee8-b563-1f874a9c501a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:33:06Z,use_quota=True,user_id='b30694fedb28497a919c0abfc19c1293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f38489-2e2d-4702-8dde-7d6b73087d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f38489-2e2d-4702-8dde-7d6b73087d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63ecb7f-9b40-43eb-acac-c5ffad2235a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63ecb7f-9b40-43eb-acac-c5ffad2235a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2eff7e15-8356-4d1b-9608-ea68ca27b48e', 'volume_name': 'volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e', 'volume_size': 2, 'snapshot_id': '75553c18-a2ca-4ee8-b563-1f874a9c501a'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec79c485-b9c3-4a36-b84c-cdb3c9f1e0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec79c485-b9c3-4a36-b84c-cdb3c9f1e0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8a0c69-9117-4463-87b1-0eb7be3a9c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:05 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Volume 2eff7e15-8356-4d1b-9608-ea68ca27b48e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e', 'volume_size': 2, 'snapshot_id': '75553c18-a2ca-4ee8-b563-1f874a9c501a'} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-75553c18-a2ca-4ee8-b563-1f874a9c501a-2eff7e15-8356-4d1b-9608-ea68ca27b48e" by "_create_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-75553c18-a2ca-4ee8-b563-1f874a9c501a-2eff7e15-8356-4d1b-9608-ea68ca27b48e" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Creating volume 2eff7e15-8356-4d1b-9608-ea68ca27b48e from snapshot 75553c18-a2ca-4ee8-b563-1f874a9c501a {{(pid=86722) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-2eff7e15-8356-4d1b-9608-ea68ca27b48e" by "_copy_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-2eff7e15-8356-4d1b-9608-ea68ca27b48e" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] snapshot: 75553c18-a2ca-4ee8-b563-1f874a9c501a, volume: 2eff7e15-8356-4d1b-9608-ea68ca27b48e, {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[25be6f87-95f7-4c0c-9e57-71e66776d042]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:05 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a Jun 04 13:33:05 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:06 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a" returned: 0 in 0.726s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:33:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 13:33:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Creating direct copy from snapshot {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 13:33:06 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc971d7-605e-40c9-af9b-d3391e332c44]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:06 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 Jun 04 13:33:06 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:07 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" returned: 0 in 0.710s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:07 devstack cinder-volume[86722]: DEBUG cinder.utils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Path /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e not found in is_blk_device check {{(pid=86722) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 13:33:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:07 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e Jun 04 13:33:07 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:10 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-f5ae2933-1eed-4608-81fc-8722d17e8deb req-d5592368-3463-4290-b6fe-559486010f74 tempest-TestShelveInstance-1652418693 None] Terminate volume connection completed successfully. Jun 04 13:33:10 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-f5ae2933-1eed-4608-81fc-8722d17e8deb req-d5592368-3463-4290-b6fe-559486010f74 tempest-TestShelveInstance-1652418693 None] Deleting attachment 69e59041-797c-4496-906c-a85de9923cfc. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:33:13 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e" returned: 0 in 5.851s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:13 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4190cc-e7f8-4ae2-9b2c-a65ac3093fc1]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:13 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 Jun 04 13:33:13 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:14 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" returned: 0 in 0.961s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:14 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:33:14 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Converted 1024.00 MB image at 174.99 MB/s Jun 04 13:33:14 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e is being set with open permissions: ugo+rw Jun 04 13:33:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:14 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e Jun 04 13:33:14 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:14 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e" returned: 0 in 0.589s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-2eff7e15-8356-4d1b-9608-ea68ca27b48e" released by "_copy_volume_from_snapshot" :: held 8.953s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-75553c18-a2ca-4ee8-b563-1f874a9c501a-2eff7e15-8356-4d1b-9608-ea68ca27b48e" released by "_create_volume_from_snapshot" :: held 8.991s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8a0c69-9117-4463-87b1-0eb7be3a9c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e', 'volume_size': 2, 'snapshot_id': '75553c18-a2ca-4ee8-b563-1f874a9c501a'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37a0449-daf7-4f01-853a-a84793f957c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:14 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Volume volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e (2eff7e15-8356-4d1b-9608-ea68ca27b48e): created successfully Jun 04 13:33:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37a0449-daf7-4f01-853a-a84793f957c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Flow 'volume_create_manager' (6b62d355-bdcf-4325-a6ee-76f4e6ff72d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:33:14 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9bc89b30-8e93-4112-9179-6d5480586889 tempest-VolumesSnapshotTestJSON-953008577 None] Created volume successfully. Jun 04 13:33:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-2eff7e15-8356-4d1b-9608-ea68ca27b48e-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-609d7b45-4b75-4cdc-a13d-67c40de437d4 req-c6e1ed14-2034-445f-bf76-3f99dcedf73e tempest-TestShelveInstance-1652418693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-609d7b45-4b75-4cdc-a13d-67c40de437d4 req-c6e1ed14-2034-445f-bf76-3f99dcedf73e tempest-TestShelveInstance-1652418693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-2eff7e15-8356-4d1b-9608-ea68ca27b48e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:15 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fac0946-1ca3-479f-826e-3fe4f974b7a4]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-609d7b45-4b75-4cdc-a13d-67c40de437d4 req-c6e1ed14-2034-445f-bf76-3f99dcedf73e tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-2eff7e15-8356-4d1b-9608-ea68ca27b48e" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-2eff7e15-8356-4d1b-9608-ea68ca27b48e" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:15 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[505a3d5e-d55e-486a-85a1-4631e8df2c12]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:15 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff Jun 04 13:33:15 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:15 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e Jun 04 13:33:15 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:16 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-609d7b45-4b75-4cdc-a13d-67c40de437d4 req-c6e1ed14-2034-445f-bf76-3f99dcedf73e tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" returned: 0 in 0.722s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-609d7b45-4b75-4cdc-a13d-67c40de437d4 req-c6e1ed14-2034-445f-bf76-3f99dcedf73e tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:16 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e" returned: 0 in 0.760s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:16 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff Jun 04 13:33:16 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:16 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e Jun 04 13:33:16 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:17 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-2eff7e15-8356-4d1b-9608-ea68ca27b48e" returned: 0 in 0.614s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:17 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-609d7b45-4b75-4cdc-a13d-67c40de437d4 req-c6e1ed14-2034-445f-bf76-3f99dcedf73e tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" returned: 1 in 0.726s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-609d7b45-4b75-4cdc-a13d-67c40de437d4 req-c6e1ed14-2034-445f-bf76-3f99dcedf73e tempest-TestShelveInstance-1652418693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-609d7b45-4b75-4cdc-a13d-67c40de437d4 req-c6e1ed14-2034-445f-bf76-3f99dcedf73e tempest-TestShelveInstance-1652418693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.501s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-2eff7e15-8356-4d1b-9608-ea68ca27b48e" released by "delete_volume" :: held 1.416s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-609d7b45-4b75-4cdc-a13d-67c40de437d4 req-c6e1ed14-2034-445f-bf76-3f99dcedf73e tempest-TestShelveInstance-1652418693 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8ea1989-dad4-4ab9-8b72-d75c2db2f1bc', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Created reservations ['b1584da3-4c8e-41da-b56f-cf3bf40ab53b', 'd6e81ea9-7f67-4dc0-925e-b74b3a7b73c4', 'df5614e1-d4ab-4eca-b7e7-fed83815cf2c', '706f48ca-a0f3-401b-8ea1-4bd4d0dab972'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:33:17 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-609d7b45-4b75-4cdc-a13d-67c40de437d4 req-c6e1ed14-2034-445f-bf76-3f99dcedf73e tempest-TestShelveInstance-1652418693 None] attachment_update completed successfully. Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:17 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:33:17 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-75553c18-a2ca-4ee8-b563-1f874a9c501a-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-75553c18-a2ca-4ee8-b563-1f874a9c501a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-75553c18-a2ca-4ee8-b563-1f874a9c501a" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-75553c18-a2ca-4ee8-b563-1f874a9c501a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Deleting offline snapshot 75553c18-a2ca-4ee8-b563-1f874a9c501a of volume c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:33:18 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] snapshot_file for this snap is: volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.636s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:33:18 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Deleted volume successfully. Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[37da1c98-94b8-4402-9e37-4248c761539b]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-512e2bf6-8aa4-445d-90b4-2df72874166e tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-2eff7e15-8356-4d1b-9608-ea68ca27b48e-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:18 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a Jun 04 13:33:18 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:18 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a" returned: 0 in 0.744s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[640f5ad1-9f75-493c-a05f-6d4f6b86d1b8]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:19 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 Jun 04 13:33:19 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-8ce022d1-f536-440c-b843-17b21ba3c003 req-5104bd57-6851-46ce-bc6f-69f3bea07cc6 tempest-TestStampPattern-1763623516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-8ce022d1-f536-440c-b843-17b21ba3c003 req-5104bd57-6851-46ce-bc6f-69f3bea07cc6 tempest-TestStampPattern-1763623516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:19 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e563313-30fa-45f3-8478-1d1d45235b40]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-8ce022d1-f536-440c-b843-17b21ba3c003 req-5104bd57-6851-46ce-bc6f-69f3bea07cc6 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:19 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 Jun 04 13:33:19 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:19 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" returned: 0 in 0.744s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:19 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a Jun 04 13:33:19 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:20 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-8ce022d1-f536-440c-b843-17b21ba3c003 req-5104bd57-6851-46ce-bc6f-69f3bea07cc6 tempest-TestStampPattern-1763623516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13" returned: 0 in 0.771s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-8ce022d1-f536-440c-b843-17b21ba3c003 req-5104bd57-6851-46ce-bc6f-69f3bea07cc6 tempest-TestStampPattern-1763623516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.788s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:20 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-8ce022d1-f536-440c-b843-17b21ba3c003 req-5104bd57-6851-46ce-bc6f-69f3bea07cc6 tempest-TestStampPattern-1763623516 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-944c0ffe-506b-4cdc-842f-2d213320cd13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44d1e013-b6ee-4f4d-ba07-506f530c74da', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:33:20 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-8ce022d1-f536-440c-b843-17b21ba3c003 req-5104bd57-6851-46ce-bc6f-69f3bea07cc6 tempest-TestStampPattern-1763623516 None] attachment_update completed successfully. Jun 04 13:33:20 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a" returned: 0 in 0.805s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:20 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a Jun 04 13:33:20 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:21 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9.75553c18-a2ca-4ee8-b563-1f874a9c501a" returned: 0 in 0.650s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:21 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-75553c18-a2ca-4ee8-b563-1f874a9c501a" released by "_delete_snapshot" :: held 3.079s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:21 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" released by "delete_snapshot" :: held 3.103s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:21 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Created reservations ['e8cdedd0-be39-43c0-9fa8-ea2e18b3692d', 'b4f90f70-69b4-43ad-9344-a33df3a35082', '1fa9996c-5dbd-4083-a454-ca7cd896df16', '534c7517-3b95-4fb4-8c21-878315e8a25a'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:33:21 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Delete snapshot completed successfully. Jun 04 13:33:21 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2851124d-d21d-49bd-8b83-514224a59714 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-75553c18-a2ca-4ee8-b563-1f874a9c501a-delete_snapshot" released by "delete_snapshot" :: held 3.249s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" acquired by "delete_volume" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:22 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0655c2-7e0d-4726-b5f0-c473c510a9b0]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:22 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 Jun 04 13:33:22 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:23 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" returned: 0 in 0.776s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:23 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9 Jun 04 13:33:23 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:23 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" returned: 0 in 0.629s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9" released by "delete_volume" :: held 1.482s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:23 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Created reservations ['8a1f388a-b6d1-4798-add1-21234fcdff21', '0d8a774c-7783-454a-b8c4-7c76729f742f', 'f50cffbb-8442-4ee9-8850-0812bca1ea57', '33c34992-7776-4934-8dd3-bed55a921f4b'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:33:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:24 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:33:24 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:33:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:24 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:33:24 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:24 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.623s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:24 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:33:24 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Deleted volume successfully. Jun 04 13:33:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-14b2c5c9-7a38-4319-9755-81209e9a3be9 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-c1b8f18e-cdf1-4240-97e2-d4bdd25319a9-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:24 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Flow 'volume_create_manager' (848da7a5-2e6b-4aa8-94a4-5d08a9297e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ec0ae6-c4cd-44e1-ab51-fd8c51467a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15ec0ae6-c4cd-44e1-ab51-fd8c51467a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-501967986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b558160-ced0-4b5a-af62-94131c038436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5824d4185db4a42b74f3e16365c159e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:33:25Z,use_quota=True,user_id='b30694fedb28497a919c0abfc19c1293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0488339a-8a34-4151-924b-2352a3d8c94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0488339a-8a34-4151-924b-2352a3d8c94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d57a95-8509-40bf-ae1e-7ad36f757a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d57a95-8509-40bf-ae1e-7ad36f757a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b558160-ced0-4b5a-af62-94131c038436', 'volume_name': 'volume-0b558160-ced0-4b5a-af62-94131c038436', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fae6dae-01b3-4c53-9b46-7ab83ab13118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fae6dae-01b3-4c53-9b46-7ab83ab13118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5ef619-ea03-4018-8206-e129dc6fb2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:25 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Volume 0b558160-ced0-4b5a-af62-94131c038436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b558160-ced0-4b5a-af62-94131c038436', 'volume_size': 1} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-501967986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b558160-ced0-4b5a-af62-94131c038436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5824d4185db4a42b74f3e16365c159e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:33:25Z,use_quota=True,user_id='b30694fedb28497a919c0abfc19c1293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Creating volume 0b558160-ced0-4b5a-af62-94131c038436 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:33:25 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:25 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 1073741824 Jun 04 13:33:25 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:25 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 1073741824" returned: 0 in 0.804s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:25 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 Jun 04 13:33:25 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:26 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436" returned: 0 in 0.644s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:33:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5ef619-ea03-4018-8206-e129dc6fb2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b558160-ced0-4b5a-af62-94131c038436', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8b2e6f-ccac-4740-888b-a83f1cc1c464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:26 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Volume volume-0b558160-ced0-4b5a-af62-94131c038436 (0b558160-ced0-4b5a-af62-94131c038436): created successfully Jun 04 13:33:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8b2e6f-ccac-4740-888b-a83f1cc1c464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Flow 'volume_create_manager' (848da7a5-2e6b-4aa8-94a4-5d08a9297e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:33:26 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-09a18574-1158-420e-a8f6-a0af2b192f1a tempest-VolumesSnapshotTestJSON-953008577 None] Created volume successfully. Jun 04 13:33:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] Creating offline snapshot 9ee2f64e-6dfe-413d-9f39-06052d75295b of volume 0b558160-ced0-4b5a-af62-94131c038436 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:33:27 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3962ecd9-031b-4edf-ad2f-41e2e95691c5]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:27 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 Jun 04 13:33:27 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:28 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436" returned: 0 in 0.898s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:28 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b 1G Jun 04 13:33:28 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:29 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-6a8c5b5a-3a6f-40a2-951c-83480701ffcc req-180c20fd-40f5-41b5-9871-aaafc26734de tempest-TestStampPattern-1763623516 None] Terminate volume connection completed successfully. Jun 04 13:33:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-6a8c5b5a-3a6f-40a2-951c-83480701ffcc req-180c20fd-40f5-41b5-9871-aaafc26734de tempest-TestStampPattern-1763623516 None] Deleting attachment 44d1e013-b6ee-4f4d-ba07-506f530c74da. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:33:29 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b 1G" returned: 0 in 1.076s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b558160-ced0-4b5a-af62-94131c038436 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:29 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b558160-ced0-4b5a-af62-94131c038436 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b Jun 04 13:33:29 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:29 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b558160-ced0-4b5a-af62-94131c038436 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b" returned: 0 in 0.645s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:29 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b is being set with open permissions: ugo+rw Jun 04 13:33:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:29 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b Jun 04 13:33:29 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:30 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b" returned: 0 in 0.632s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:30 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.info Jun 04 13:33:30 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:31 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.info" returned: 0 in 0.685s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:31 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.info is being set with open permissions: ugo+rw Jun 04 13:33:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:31 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.info Jun 04 13:33:31 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:31 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.info" returned: 0 in 0.618s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.657s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.860s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:31 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=63,cinder:UPDATE=47,cinder:DELETE=6,cinder:INSERT=13 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:33:31 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=52,cinder:SELECT=62,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:33:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] Creating offline snapshot d8cafc70-eddd-44cc-8405-e898db98d4f7 of volume 944c0ffe-506b-4cdc-842f-2d213320cd13 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:33:31 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbb2c36-630e-4219-ba88-ebc49238e40c]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:32 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ab0a2308-8e2a-49af-ae07-c06ad5708972 tempest-VolumesSnapshotTestJSON-953008577 None] Create snapshot completed successfully Jun 04 13:33:32 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 Jun 04 13:33:32 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:32 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13" returned: 0 in 0.817s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:32 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 1G Jun 04 13:33:32 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Flow 'volume_create_manager' (a845e60b-e60d-49f8-8a39-429c80a267f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7fd827-4451-4deb-a37a-f413e75668ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7fd827-4451-4deb-a37a-f413e75668ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-262649664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ee1b8c-a363-4d79-8366-6926b444a8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5824d4185db4a42b74f3e16365c159e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ee2f64e-6dfe-413d-9f39-06052d75295b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:33:33Z,use_quota=True,user_id='b30694fedb28497a919c0abfc19c1293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba4c0fc-ba9b-4dc0-9e4e-88115e909d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba4c0fc-ba9b-4dc0-9e4e-88115e909d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b322c7a-85ac-4ca6-bde2-70aedc4260cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b322c7a-85ac-4ca6-bde2-70aedc4260cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a2ee1b8c-a363-4d79-8366-6926b444a8ae', 'volume_name': 'volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae', 'volume_size': 1, 'snapshot_id': '9ee2f64e-6dfe-413d-9f39-06052d75295b'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a194b8-9112-48c0-bb77-e6762659df58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a194b8-9112-48c0-bb77-e6762659df58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6fc882-b44a-40a1-ae9e-7c4452b39357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:33 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Volume a2ee1b8c-a363-4d79-8366-6926b444a8ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae', 'volume_size': 1, 'snapshot_id': '9ee2f64e-6dfe-413d-9f39-06052d75295b'} Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:33 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 1G" returned: 0 in 0.875s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944c0ffe-506b-4cdc-842f-2d213320cd13 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:33 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944c0ffe-506b-4cdc-842f-2d213320cd13 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 Jun 04 13:33:33 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:34 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-944c0ffe-506b-4cdc-842f-2d213320cd13 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7" returned: 0 in 0.668s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:34 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 is being set with open permissions: ugo+rw Jun 04 13:33:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:34 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 Jun 04 13:33:34 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:34 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7" returned: 0 in 0.603s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:35 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.info Jun 04 13:33:35 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:35 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.info" returned: 0 in 0.599s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:35 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.info is being set with open permissions: ugo+rw Jun 04 13:33:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:35 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.info Jun 04 13:33:35 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:36 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.info" returned: 0 in 0.579s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.265s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.958s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-9ee2f64e-6dfe-413d-9f39-06052d75295b-a2ee1b8c-a363-4d79-8366-6926b444a8ae" by "_create_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:36 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-0e12decd-112f-48bc-b898-f0366a7ce3da tempest-TestStampPattern-1763623516 None] Create snapshot completed successfully Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-9ee2f64e-6dfe-413d-9f39-06052d75295b-a2ee1b8c-a363-4d79-8366-6926b444a8ae" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Creating volume a2ee1b8c-a363-4d79-8366-6926b444a8ae from snapshot 9ee2f64e-6dfe-413d-9f39-06052d75295b {{(pid=86722) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-a2ee1b8c-a363-4d79-8366-6926b444a8ae" by "_copy_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-a2ee1b8c-a363-4d79-8366-6926b444a8ae" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] snapshot: 9ee2f64e-6dfe-413d-9f39-06052d75295b, volume: a2ee1b8c-a363-4d79-8366-6926b444a8ae, {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd50b95b-6057-4916-8e94-c0ee9980d04f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:36 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b Jun 04 13:33:36 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:37 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b" returned: 0 in 0.719s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b558160-ced0-4b5a-af62-94131c038436(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:33:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 13:33:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Creating direct copy from snapshot {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 13:33:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bd48e8-4065-49f0-ae4d-75ace0f46769]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:37 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 Jun 04 13:33:37 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:37 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436" returned: 0 in 0.744s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:37 devstack cinder-volume[86722]: DEBUG cinder.utils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Path /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae not found in is_blk_device check {{(pid=86722) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 13:33:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:37 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae Jun 04 13:33:37 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:43 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae" returned: 0 in 5.835s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:43 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7805576-d710-4878-bf3e-39f0034e51c8]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:43 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 Jun 04 13:33:43 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:44 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436" returned: 0 in 0.925s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:44 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:33:44 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Converted 1024.00 MB image at 175.46 MB/s Jun 04 13:33:44 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae is being set with open permissions: ugo+rw Jun 04 13:33:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:44 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae Jun 04 13:33:44 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:45 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae" returned: 0 in 0.669s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-a2ee1b8c-a363-4d79-8366-6926b444a8ae" released by "_copy_volume_from_snapshot" :: held 9.001s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-9ee2f64e-6dfe-413d-9f39-06052d75295b-a2ee1b8c-a363-4d79-8366-6926b444a8ae" released by "_create_volume_from_snapshot" :: held 9.046s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.096s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6fc882-b44a-40a1-ae9e-7c4452b39357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae', 'volume_size': 1, 'snapshot_id': '9ee2f64e-6dfe-413d-9f39-06052d75295b'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9a19ec-82c2-47a1-8f6b-e12d8df8eaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:45 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Volume volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae (a2ee1b8c-a363-4d79-8366-6926b444a8ae): created successfully Jun 04 13:33:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e9a19ec-82c2-47a1-8f6b-e12d8df8eaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Flow 'volume_create_manager' (a845e60b-e60d-49f8-8a39-429c80a267f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:33:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fec597ec-b75e-4182-bce6-d4773b1c35e8 tempest-VolumesSnapshotTestJSON-953008577 None] Created volume successfully. Jun 04 13:33:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-a2ee1b8c-a363-4d79-8366-6926b444a8ae-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-a2ee1b8c-a363-4d79-8366-6926b444a8ae-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-a2ee1b8c-a363-4d79-8366-6926b444a8ae" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-a2ee1b8c-a363-4d79-8366-6926b444a8ae" acquired by "delete_volume" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f6a429-1e53-4226-b3e0-deedc6d9041a]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:46 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae Jun 04 13:33:46 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:47 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae" returned: 0 in 0.724s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:47 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae Jun 04 13:33:47 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:48 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a2ee1b8c-a363-4d79-8366-6926b444a8ae" returned: 0 in 0.601s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-a2ee1b8c-a363-4d79-8366-6926b444a8ae" released by "delete_volume" :: held 1.383s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Created reservations ['268b3e4b-01cf-4705-b43c-9f7bf0a633e7', '0f71a63e-8370-46fe-8b16-108e8bb55a5c', '4709bc12-f323-49d0-839d-592fa8d19e0c', '22dfff06-dc3b-450c-af86-26144d24ae06'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:48 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:33:48 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Flow 'volume_create_manager' (44fc90e8-93fd-4e86-b931-7021a17b487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307f910e-8498-4633-a977-465d2c202ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307f910e-8498-4633-a977-465d2c202ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-751162822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b7de273-fc88-4534-a45b-ce060024fd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3eedb182054f71a853f4fd60b2181d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8cafc70-eddd-44cc-8405-e898db98d4f7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:33:48Z,use_quota=True,user_id='fd13796d9e87459293cd80c068dd4b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65315c63-8c19-48e6-a103-2648b9ac89d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65315c63-8c19-48e6-a103-2648b9ac89d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084cf91e-fafa-4878-9453-aa3e7985adbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084cf91e-fafa-4878-9453-aa3e7985adbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0b7de273-fc88-4534-a45b-ce060024fd10', 'volume_name': 'volume-0b7de273-fc88-4534-a45b-ce060024fd10', 'volume_size': 1, 'snapshot_id': 'd8cafc70-eddd-44cc-8405-e898db98d4f7'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4483cbdb-3b1a-4d4e-975f-0d26606f9a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4483cbdb-3b1a-4d4e-975f-0d26606f9a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5127f606-2fa3-450f-a271-6c21a9d98a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:48 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Volume 0b7de273-fc88-4534-a45b-ce060024fd10: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0b7de273-fc88-4534-a45b-ce060024fd10', 'volume_size': 1, 'snapshot_id': 'd8cafc70-eddd-44cc-8405-e898db98d4f7'} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Acquiring lock "cinder-quobyte-d8cafc70-eddd-44cc-8405-e898db98d4f7-0b7de273-fc88-4534-a45b-ce060024fd10" by "_create_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Lock "cinder-quobyte-d8cafc70-eddd-44cc-8405-e898db98d4f7-0b7de273-fc88-4534-a45b-ce060024fd10" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Creating volume 0b7de273-fc88-4534-a45b-ce060024fd10 from snapshot d8cafc70-eddd-44cc-8405-e898db98d4f7 {{(pid=86722) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Acquiring lock "cinder-quobyte-0b7de273-fc88-4534-a45b-ce060024fd10" by "_copy_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Lock "cinder-quobyte-0b7de273-fc88-4534-a45b-ce060024fd10" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] snapshot: d8cafc70-eddd-44cc-8405-e898db98d4f7, volume: 0b7de273-fc88-4534-a45b-ce060024fd10, {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[2092d5b9-7f9f-44c2-a971-275d2c574126]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:48 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.692s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:33:48 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Deleted volume successfully. Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-9ee2f64e-6dfe-413d-9f39-06052d75295b-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:48 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 Jun 04 13:33:48 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-461435f1-db3f-495e-a993-e14b389038c1 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-a2ee1b8c-a363-4d79-8366-6926b444a8ae-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-9ee2f64e-6dfe-413d-9f39-06052d75295b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-0b558160-ced0-4b5a-af62-94131c038436" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-0b558160-ced0-4b5a-af62-94131c038436" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-9ee2f64e-6dfe-413d-9f39-06052d75295b" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-9ee2f64e-6dfe-413d-9f39-06052d75295b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Deleting offline snapshot 9ee2f64e-6dfe-413d-9f39-06052d75295b of volume 0b558160-ced0-4b5a-af62-94131c038436 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] snapshot_file for this snap is: volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b85e2d-4be8-499c-ac32-b74b6c8f1e7d]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:49 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b Jun 04 13:33:49 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:49 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7" returned: 0 in 0.832s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944c0ffe-506b-4cdc-842f-2d213320cd13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:33:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 13:33:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Creating direct copy from snapshot {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 13:33:49 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[245c2fb5-afbd-4b46-8d2e-25f7418e0dfd]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:49 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 Jun 04 13:33:49 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:49 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b" returned: 0 in 0.756s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b558160-ced0-4b5a-af62-94131c038436(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:33:49 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dfa198-064c-4295-bb7a-e9bd34553135]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:49 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 Jun 04 13:33:49 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:50 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13" returned: 0 in 0.735s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:50 devstack cinder-volume[86722]: DEBUG cinder.utils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Path /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 not found in is_blk_device check {{(pid=86722) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 13:33:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:50 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 Jun 04 13:33:50 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:50 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436" returned: 0 in 0.799s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:50 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b Jun 04 13:33:50 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:51 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b" returned: 0 in 1.012s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:51 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b Jun 04 13:33:51 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:52 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436.9ee2f64e-6dfe-413d-9f39-06052d75295b" returned: 0 in 0.988s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-9ee2f64e-6dfe-413d-9f39-06052d75295b" released by "_delete_snapshot" :: held 3.704s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-0b558160-ced0-4b5a-af62-94131c038436" released by "delete_snapshot" :: held 3.737s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:52 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Created reservations ['3140dbf4-17c2-4e5f-bfc1-3dac1ec535bc', '514743ad-062f-4ec9-8b62-e10ec4a6e542', '1eda9ee1-3e2e-427b-821a-557d73a41fbf', '634e06c9-a93d-4d58-bfe4-cdb8fc93f303'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:33:52 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Delete snapshot completed successfully. Jun 04 13:33:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-35b6abef-3f84-4dad-8322-954720d32058 tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-9ee2f64e-6dfe-413d-9f39-06052d75295b-delete_snapshot" released by "delete_snapshot" :: held 4.050s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-0b558160-ced0-4b5a-af62-94131c038436-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-0b558160-ced0-4b5a-af62-94131c038436-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-0b558160-ced0-4b5a-af62-94131c038436" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-0b558160-ced0-4b5a-af62-94131c038436" acquired by "delete_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:53 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6188646-239c-46f7-9ddd-6ca2667f58df]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:53 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 Jun 04 13:33:53 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:55 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436" returned: 0 in 1.991s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:55 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436 Jun 04 13:33:55 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:57 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10" returned: 0 in 6.666s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:57 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[436f1918-b3b4-4d61-a8dd-f564d2d94bb3]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:57 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 Jun 04 13:33:57 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:57 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b558160-ced0-4b5a-af62-94131c038436" returned: 0 in 1.532s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-0b558160-ced0-4b5a-af62-94131c038436" released by "delete_volume" :: held 3.683s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:57 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Created reservations ['ec3d84c6-6b01-48b7-9847-23ca7a8f0654', 'd8f8b77f-92b6-44bc-ac56-6540b342d416', '9cb28ac1-cc35-41ca-bf6d-a8b06b3a3b10', '58fbb7ea-32ee-44f8-8a3d-a1b927916bef'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:33:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:33:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:33:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:33:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:33:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:57 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:33:57 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-a416972b-d9c9-4368-be78-6f87d89e56ac-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-a416972b-d9c9-4368-be78-6f87d89e56ac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:58 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13" returned: 0 in 1.232s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:58 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:33:58 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Converted 1024.00 MB image at 153.58 MB/s Jun 04 13:33:58 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 is being set with open permissions: ugo+rw Jun 04 13:33:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "cinder-quobyte-a416972b-d9c9-4368-be78-6f87d89e56ac" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:33:58 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 Jun 04 13:33:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-a416972b-d9c9-4368-be78-6f87d89e56ac" acquired by "delete_volume" :: waited 0.028s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:33:58 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:58 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e353ff2-e37f-4416-a5aa-0ba402a810ef]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:33:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:58 devstack sudo[103335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac Jun 04 13:33:58 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:33:58 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.310s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:58 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:33:58 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Deleted volume successfully. Jun 04 13:33:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef4f7cec-4081-48e0-827b-5ab3ecd9727f tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-0b558160-ced0-4b5a-af62-94131c038436-delete_volume" released by "delete_volume" :: held 5.427s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:59 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10" returned: 0 in 0.915s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Lock "cinder-quobyte-0b7de273-fc88-4534-a45b-ce060024fd10" released by "_copy_volume_from_snapshot" :: held 10.502s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Lock "cinder-quobyte-d8cafc70-eddd-44cc-8405-e898db98d4f7-0b7de273-fc88-4534-a45b-ce060024fd10" released by "_create_volume_from_snapshot" :: held 10.549s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:33:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.566s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:33:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5127f606-2fa3-450f-a271-6c21a9d98a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b7de273-fc88-4534-a45b-ce060024fd10', 'volume_size': 1, 'snapshot_id': 'd8cafc70-eddd-44cc-8405-e898db98d4f7'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b421125-a4a3-479b-8e9b-26dc0f43401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:33:59 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Volume volume-0b7de273-fc88-4534-a45b-ce060024fd10 (0b7de273-fc88-4534-a45b-ce060024fd10): created successfully Jun 04 13:33:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b421125-a4a3-479b-8e9b-26dc0f43401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:33:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Flow 'volume_create_manager' (44fc90e8-93fd-4e86-b931-7021a17b487d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:33:59 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d5583ef0-1286-420d-9be1-ae9bfa7853e9 tempest-TestStampPattern-1763623516 None] Created volume successfully. Jun 04 13:33:59 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root Jun 04 13:33:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac" returned: 0 in 1.042s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:33:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:33:59 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac Jun 04 13:33:59 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:00 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a416972b-d9c9-4368-be78-6f87d89e56ac" returned: 0 in 0.680s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-quobyte-a416972b-d9c9-4368-be78-6f87d89e56ac" released by "delete_volume" :: held 1.851s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:00 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Created reservations ['828e7d69-63a2-4c8a-bc46-761e7cca690f', '181468d9-bf77-4b47-a5f4-6f8080f00c06', '47fd156a-32d8-44ef-8b9b-2b1cef9cd6d6', 'bd46e746-eed0-47ed-b0fc-499ab6a02d38'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:34:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:34:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:34:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:00 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:34:00 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:00 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.629s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:00 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:34:00 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Deleted volume successfully. Jun 04 13:34:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f66a353b-8747-42f4-a7cc-c59bff222c4b tempest-VolumesSnapshotTestJSON-953008577 None] Lock "cinder-a416972b-d9c9-4368-be78-6f87d89e56ac-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:34:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:34:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:34:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:04 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:34:04 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:04 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.848s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:34:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:34:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:34:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:34:10 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=31,cinder:DELETE=4,cinder:SELECT=27,cinder:INSERT=10 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:34:10 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=39,cinder:SELECT=29,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:34:11 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:34:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Flow 'volume_create_manager' (e52e2b8f-9251-4a72-ba05-e259d901c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:34:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fe22f5-fb87-41cf-a2b1-388d5963bc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7fe22f5-fb87-41cf-a2b1-388d5963bc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98e3521-89c1-4f23-bbf5-f315618ce34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e519107ad223461f8e58c2ed65c232bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:34:12Z,use_quota=True,user_id='0c16252aab0a4d10a29ab86a8bf89e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e9090f-6b23-4f68-814b-0b628f75cd77),volume_type_id=f6e9090f-6b23-4f68-814b-0b628f75cd77)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437a3164-4e2e-4c35-a0d2-4eb864004170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437a3164-4e2e-4c35-a0d2-4eb864004170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341161fd-8bbd-442a-9770-c7786f2d75eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG cinder.image.glance [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Creating Keystone auth plugin from conf {{(pid=86722) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341161fd-8bbd-442a-9770-c7786f2d75eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c98e3521-89c1-4f23-bbf5-f315618ce34f', 'volume_name': 'volume-c98e3521-89c1-4f23-bbf5-f315618ce34f', 'volume_size': 1, 'image_id': 'd4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9caa27c6f82227c4781aeab4d34fb798', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e519107ad223461f8e58c2ed65c232bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd59ba8464f2ddca891daa48c32b490c8f9d4cf66d65f1f9b749117d3a1a43be4005298b41f93da5608a5b565c4401209678ed1faa12c555cd94d6a6ac04b9181', 'id': 'd4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'created_at': datetime.datetime(2026, 6, 4, 11, 34, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 34, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4fb37ec-8328-4d43-832f-a75aeccc1dd6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e3a458-2019-429a-ac1b-baa43fa9b954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e3a458-2019-429a-ac1b-baa43fa9b954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2e0d47-c84a-4dd1-b5d8-b571564f3d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:12 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Volume c98e3521-89c1-4f23-bbf5-f315618ce34f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c98e3521-89c1-4f23-bbf5-f315618ce34f', 'volume_size': 1, 'image_id': 'd4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9caa27c6f82227c4781aeab4d34fb798', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e519107ad223461f8e58c2ed65c232bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd59ba8464f2ddca891daa48c32b490c8f9d4cf66d65f1f9b749117d3a1a43be4005298b41f93da5608a5b565c4401209678ed1faa12c555cd94d6a6ac04b9181', 'id': 'd4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'created_at': datetime.datetime(2026, 6, 4, 11, 34, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 34, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4fb37ec-8328-4d43-832f-a75aeccc1dd6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Trying to clone c98e3521-89c1-4f23-bbf5-f315618ce34f from image d4fb37ec-8328-4d43-832f-a75aeccc1dd6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'metadata': {}}]). {{(pid=86722) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 13:34:12 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Image download 0.00 MB at 0.00 MB/s Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff77a90b-3d09-4e50-b568-bd2e30736113]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:12 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-58e11c0c-0ad5-4e9b-88b2-8378342480a3 tempest-TestShelveInstance-1652418693 None] Terminate volume connection completed successfully. Jun 04 13:34:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-58e11c0c-0ad5-4e9b-88b2-8378342480a3 tempest-TestShelveInstance-1652418693 None] Deleting attachment a8ea1989-dad4-4ab9-8b72-d75c2db2f1bc. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:34:12 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD Jun 04 13:34:12 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:13 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Acquiring lock "cinder-384fcfff-6e74-4927-8a2d-11edc9c2b0ff-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:13 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:13 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Lock "cinder-384fcfff-6e74-4927-8a2d-11edc9c2b0ff-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:13 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Acquiring lock "cinder-quobyte-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:13 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Lock "cinder-quobyte-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" acquired by "delete_volume" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:13 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD Jun 04 13:34:13 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:13 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bbd9b7-7757-4899-b0e2-f2dad4734cf7]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:13 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff Jun 04 13:34:13 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:14 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD" returned: 1 in 0.867s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:34:14 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Temporary image d4fb37ec-8328-4d43-832f-a75aeccc1dd6 is fetched for user 0c16252aab0a4d10a29ab86a8bf89e48. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 13:34:14 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[106017f7-4c12-4029-9da8-47893c3cde32]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:14 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD Jun 04 13:34:14 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:14 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" returned: 0 in 0.946s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:14 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff Jun 04 13:34:14 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:14 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD" returned: 0 in 0.681s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:14 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD Jun 04 13:34:14 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:14 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" returned: 1 in 0.722s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:15 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff Jun 04 13:34:15 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:15 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD" returned: 1 in 0.757s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98e3521-89c1-4f23-bbf5-f315618ce34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e519107ad223461f8e58c2ed65c232bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:34:12Z,use_quota=True,user_id='0c16252aab0a4d10a29ab86a8bf89e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6e9090f-6b23-4f68-814b-0b628f75cd77),volume_type_id=f6e9090f-6b23-4f68-814b-0b628f75cd77)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Creating volume c98e3521-89c1-4f23-bbf5-f315618ce34f {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:34:15 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:15 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f 1073741824 Jun 04 13:34:15 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:15 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" returned: 0 in 0.734s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Lock "cinder-quobyte-384fcfff-6e74-4927-8a2d-11edc9c2b0ff" released by "delete_volume" :: held 2.487s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG cinder.quota [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Created reservations ['bc3e8182-78f4-4ef5-afc7-5e475ef65ce6', '0fb14de7-e3ac-45f3-81bf-6de770cceaad', 'da493d8f-15f3-46dd-8f04-0a3965603013', '811e902f-5728-4236-8e35-c00a5e6f1aa3'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:15 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:34:15 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:16 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f 1073741824" returned: 0 in 0.894s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:16 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f Jun 04 13:34:16 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:16 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.744s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:16 devstack cinder-volume[86722]: DEBUG cinder.manager [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:34:16 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Deleted volume successfully. Jun 04 13:34:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [req-1fafdf06-6594-4026-bb5c-a8548f251f95 req-459ffb5d-8f10-48b2-9fe7-13b1b84612e7 tempest-TestShelveInstance-1652418693 None] Lock "cinder-384fcfff-6e74-4927-8a2d-11edc9c2b0ff-delete_volume" released by "delete_volume" :: held 3.479s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:17 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f" returned: 0 in 0.721s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:17 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:34:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:17 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Attempting download of d4fb37ec-8328-4d43-832f-a75aeccc1dd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'metadata': {}}])) to volume c98e3521-89c1-4f23-bbf5-f315618ce34f. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 13:34:17 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13e5d24-b1ee-4ae6-84f2-0483f2180640]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_tv6erk3n {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:17 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_tv6erk3n Jun 04 13:34:17 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:18 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_tv6erk3n" returned: 0 in 0.808s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_tv6erk3n {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:18 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_tv6erk3n Jun 04 13:34:18 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:18 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_tv6erk3n" returned: 1 in 0.731s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_tv6erk3n' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:34:18 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[538dbcf6-fb8d-4494-83e3-94a611d72bae]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:19 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD Jun 04 13:34:19 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:19 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD" returned: 0 in 0.705s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:19 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD Jun 04 13:34:19 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:20 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD" returned: 1 in 0.707s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:34:20 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] d4fb37ec-8328-4d43-832f-a75aeccc1dd6 was raw, converting to raw {{(pid=86722) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 13:34:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:20 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f Jun 04 13:34:20 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:21 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f" returned: 0 in 0.694s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:21 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d4fb37ec-8328-4d43-832f-a75aeccc1dd6_lxx_fkzpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:34:21 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Converted 0.00 MB image at 0.00 MB/s Jun 04 13:34:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:21 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f 1G Jun 04 13:34:21 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:21 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f 1G" returned: 0 in 0.657s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:21 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe37535-5e5d-4402-842a-2c9a5e193e74]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:21 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f Jun 04 13:34:21 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:22 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f" returned: 0 in 0.734s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:22 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f Jun 04 13:34:22 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:23 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f" returned: 1 in 0.708s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Downloaded image d4fb37ec-8328-4d43-832f-a75aeccc1dd6 ((None, [{'url': 'file:///opt/stack/data/glance/images/d4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'metadata': {}}])) to volume c98e3521-89c1-4f23-bbf5-f315618ce34f successfully. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Temporary image d4fb37ec-8328-4d43-832f-a75aeccc1dd6 for user 0c16252aab0a4d10a29ab86a8bf89e48 is deleted. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Marking volume c98e3521-89c1-4f23-bbf5-f315618ce34f as bootable. {{(pid=86722) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Copying metadata from image d4fb37ec-8328-4d43-832f-a75aeccc1dd6 to c98e3521-89c1-4f23-bbf5-f315618ce34f. {{(pid=86722) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Creating volume glance metadata for volume c98e3521-89c1-4f23-bbf5-f315618ce34f backed by image d4fb37ec-8328-4d43-832f-a75aeccc1dd6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9caa27c6f82227c4781aeab4d34fb798', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86722) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d2e0d47-c84a-4dd1-b5d8-b571564f3d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98e3521-89c1-4f23-bbf5-f315618ce34f', 'volume_size': 1, 'image_id': 'd4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9caa27c6f82227c4781aeab4d34fb798', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e519107ad223461f8e58c2ed65c232bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd59ba8464f2ddca891daa48c32b490c8f9d4cf66d65f1f9b749117d3a1a43be4005298b41f93da5608a5b565c4401209678ed1faa12c555cd94d6a6ac04b9181', 'id': 'd4fb37ec-8328-4d43-832f-a75aeccc1dd6', 'created_at': datetime.datetime(2026, 6, 4, 11, 34, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 34, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d4fb37ec-8328-4d43-832f-a75aeccc1dd6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee4b031-11ae-4db5-9973-0856c5c699ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:23 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Volume volume-c98e3521-89c1-4f23-bbf5-f315618ce34f (c98e3521-89c1-4f23-bbf5-f315618ce34f): created successfully Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ee4b031-11ae-4db5-9973-0856c5c699ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Flow 'volume_create_manager' (e52e2b8f-9251-4a72-ba05-e259d901c098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:34:23 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f5fa2af1-4acf-4cd6-ad18-34089310fe54 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Created volume successfully. Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Acquiring lock "cinder-c98e3521-89c1-4f23-bbf5-f315618ce34f-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Lock "cinder-c98e3521-89c1-4f23-bbf5-f315618ce34f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Acquiring lock "cinder-quobyte-c98e3521-89c1-4f23-bbf5-f315618ce34f" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Lock "cinder-quobyte-c98e3521-89c1-4f23-bbf5-f315618ce34f" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[275f291c-229c-466f-b9fa-1fff55f3cc7b]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:24 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f Jun 04 13:34:24 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:24 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f" returned: 0 in 0.769s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:24 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f Jun 04 13:34:24 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:25 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f" returned: 1 in 0.768s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:34:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:25 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f Jun 04 13:34:25 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:26 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c98e3521-89c1-4f23-bbf5-f315618ce34f" returned: 0 in 0.655s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:26 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Lock "cinder-quobyte-c98e3521-89c1-4f23-bbf5-f315618ce34f" released by "delete_volume" :: held 2.277s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:26 devstack cinder-volume[86722]: WARNING cinder.quota [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:34:26 devstack cinder-volume[86722]: WARNING cinder.quota [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 04 13:34:26 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Created reservations ['0b2e6521-74ff-4786-af38-599563ef6caa', '6df81b21-ae33-40b0-a18d-33182cac979c', '2cb646be-baea-4ecc-aa57-1a6968f563eb', '73315a9a-2b26-4156-9ef4-8506cc0a5891'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:34:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:34:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:34:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:26 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:34:26 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:26 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.615s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:26 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:34:26 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Deleted volume successfully. Jun 04 13:34:26 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-b2aa6117-93a2-47b4-9892-3de86aecc9e2 tempest-VolumeAndVolumeTypeFromImageTest-1224747646 None] Lock "cinder-c98e3521-89c1-4f23-bbf5-f315618ce34f-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Flow 'volume_create_manager' (d928cc64-4c12-48ef-bc94-606744560639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28c239f-e67c-404b-91fc-ce4fa069564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28c239f-e67c-404b-91fc-ce4fa069564f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1133550486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00be3b7d-f0f7-4692-b3b0-5f7a70a9abed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529b184a781645e7a121fa5116c76df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:34:27Z,use_quota=True,user_id='534366d1900c42969059a5566e536f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177c12da-e049-4655-8610-eef20bca3c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177c12da-e049-4655-8610-eef20bca3c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb4487a-88e0-4aa8-97a4-45b35b680e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb4487a-88e0-4aa8-97a4-45b35b680e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00be3b7d-f0f7-4692-b3b0-5f7a70a9abed', 'volume_name': 'volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0398e8ac-2242-4e1c-aea3-ee1b8655c269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0398e8ac-2242-4e1c-aea3-ee1b8655c269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24e8d07-7d17-4397-bf69-e16a36528fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:27 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Volume 00be3b7d-f0f7-4692-b3b0-5f7a70a9abed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed', 'volume_size': 1} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1133550486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00be3b7d-f0f7-4692-b3b0-5f7a70a9abed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529b184a781645e7a121fa5116c76df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:34:27Z,use_quota=True,user_id='534366d1900c42969059a5566e536f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Creating volume 00be3b7d-f0f7-4692-b3b0-5f7a70a9abed {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:34:27 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:34:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:27 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed 1073741824 Jun 04 13:34:27 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:28 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed 1073741824" returned: 0 in 0.860s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:28 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed Jun 04 13:34:28 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:29 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" returned: 0 in 0.651s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:34:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24e8d07-7d17-4397-bf69-e16a36528fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4973f3-6c1f-4592-8a51-7061fce459c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:29 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Volume volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed (00be3b7d-f0f7-4692-b3b0-5f7a70a9abed): created successfully Jun 04 13:34:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4973f3-6c1f-4592-8a51-7061fce459c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Flow 'volume_create_manager' (d928cc64-4c12-48ef-bc94-606744560639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:34:29 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-832ef44b-5546-42d3-ad5c-51ce52e087e8 tempest-VolumeDependencyTests-488151126 None] Created volume successfully. Jun 04 13:34:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] Creating offline snapshot a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 of volume 00be3b7d-f0f7-4692-b3b0-5f7a70a9abed {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:34:29 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[152f6fc6-7ed4-4e86-866c-0ff0073446df]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:30 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed Jun 04 13:34:30 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:30 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" returned: 0 in 0.777s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:30 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 1G Jun 04 13:34:30 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:31 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 1G" returned: 0 in 0.858s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:31 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 Jun 04 13:34:31 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:32 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39" returned: 0 in 0.760s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:32 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 is being set with open permissions: ugo+rw Jun 04 13:34:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:32 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 Jun 04 13:34:32 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:32 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39" returned: 0 in 0.622s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:32 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.info Jun 04 13:34:32 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:33 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.info" returned: 0 in 0.632s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:33 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.info is being set with open permissions: ugo+rw Jun 04 13:34:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:33 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.info Jun 04 13:34:33 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:34 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.info" returned: 0 in 0.642s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.397s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:34 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-5a711caf-b7f9-49b9-925f-14b95b558355 tempest-VolumeDependencyTests-488151126 None] Create snapshot completed successfully Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-1b845a5e-06da-4e1a-9c0f-7d15550b77e3 req-74aeb05d-2679-404a-8528-2ea78b0b8029 tempest-TestStampPattern-1763623516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-1b845a5e-06da-4e1a-9c0f-7d15550b77e3 req-74aeb05d-2679-404a-8528-2ea78b0b8029 tempest-TestStampPattern-1763623516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Flow 'volume_create_manager' (62eed45e-2f18-466c-9fc1-ab7e4772ca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e079dbb-e37a-4426-83dc-b9af4e0678fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be8ef7c-0772-44ad-9ccd-0a1e4a40c0e6]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1b845a5e-06da-4e1a-9c0f-7d15550b77e3 req-74aeb05d-2679-404a-8528-2ea78b0b8029 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e079dbb-e37a-4426-83dc-b9af4e0678fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-681225385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a0d4a48-da6d-411b-8971-0acf51992e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='529b184a781645e7a121fa5116c76df5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:34:36Z,use_quota=True,user_id='534366d1900c42969059a5566e536f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eacd636-2e2e-470d-aad2-18254fd1ce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eacd636-2e2e-470d-aad2-18254fd1ce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eaad902-ae9c-42e0-ad07-c71feac5c5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eaad902-ae9c-42e0-ad07-c71feac5c5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a0d4a48-da6d-411b-8971-0acf51992e4b', 'volume_name': 'volume-0a0d4a48-da6d-411b-8971-0acf51992e4b', 'volume_size': 1, 'snapshot_id': 'a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d273fc9f-8095-4a40-82f4-76ef238c0b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d273fc9f-8095-4a40-82f4-76ef238c0b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd570cf8-479d-45c6-a8d2-8ade2749e064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:35 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Volume 0a0d4a48-da6d-411b-8971-0acf51992e4b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a0d4a48-da6d-411b-8971-0acf51992e4b', 'volume_size': 1, 'snapshot_id': 'a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39'} Jun 04 13:34:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:35 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 Jun 04 13:34:35 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:36 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [req-1b845a5e-06da-4e1a-9c0f-7d15550b77e3 req-74aeb05d-2679-404a-8528-2ea78b0b8029 tempest-TestStampPattern-1763623516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10" returned: 0 in 0.765s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [req-1b845a5e-06da-4e1a-9c0f-7d15550b77e3 req-74aeb05d-2679-404a-8528-2ea78b0b8029 tempest-TestStampPattern-1763623516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.806s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.687s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "cinder-quobyte-a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39-0a0d4a48-da6d-411b-8971-0acf51992e4b" by "_create_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-quobyte-a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39-0a0d4a48-da6d-411b-8971-0acf51992e4b" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Creating volume 0a0d4a48-da6d-411b-8971-0acf51992e4b from snapshot a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 {{(pid=86722) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "cinder-quobyte-0a0d4a48-da6d-411b-8971-0acf51992e4b" by "_copy_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-quobyte-0a0d4a48-da6d-411b-8971-0acf51992e4b" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] snapshot: a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39, volume: 0a0d4a48-da6d-411b-8971-0acf51992e4b, {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-1b845a5e-06da-4e1a-9c0f-7d15550b77e3 req-74aeb05d-2679-404a-8528-2ea78b0b8029 tempest-TestStampPattern-1763623516 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076', 'name': 'volume-0b7de273-fc88-4534-a45b-ce060024fd10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a8ee774-d396-4217-a65b-3cc1fa8c32e1', 'enforce_multipath': True} {{(pid=86722) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41ac2df-302a-44c5-8a1e-6f1a3b5ed4c6]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:36 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-1b845a5e-06da-4e1a-9c0f-7d15550b77e3 req-74aeb05d-2679-404a-8528-2ea78b0b8029 tempest-TestStampPattern-1763623516 None] attachment_update completed successfully. Jun 04 13:34:36 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 Jun 04 13:34:36 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:37 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39" returned: 0 in 0.911s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:34:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 13:34:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Creating direct copy from snapshot {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 13:34:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffbe2ce-76d4-4bc4-aed4-ba3bcea12238]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:37 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed Jun 04 13:34:37 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:38 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" returned: 0 in 0.865s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:38 devstack cinder-volume[86722]: DEBUG cinder.utils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Path /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b not found in is_blk_device check {{(pid=86722) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 13:34:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:38 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b Jun 04 13:34:38 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:44 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b" returned: 0 in 6.020s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:44 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9210973-4f4b-40a2-abf2-010fdc1dd213]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:44 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed Jun 04 13:34:44 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:44 devstack cinder-volume[86722]: INFO cinder.volume.manager [req-3bafdb47-9b58-4b97-820b-4928e835e61b req-6a5b37d5-1f6c-4a44-a7fd-2c08f0843234 tempest-TestStampPattern-1763623516 None] Terminate volume connection completed successfully. Jun 04 13:34:44 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [req-3bafdb47-9b58-4b97-820b-4928e835e61b req-6a5b37d5-1f6c-4a44-a7fd-2c08f0843234 tempest-TestStampPattern-1763623516 None] Deleting attachment 9a8ee774-d396-4217-a65b-3cc1fa8c32e1. {{(pid=86722) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jun 04 13:34:45 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" returned: 0 in 0.967s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:45 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:34:45 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Converted 1024.00 MB image at 170.06 MB/s Jun 04 13:34:45 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b is being set with open permissions: ugo+rw Jun 04 13:34:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:45 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b Jun 04 13:34:45 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:46 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b" returned: 0 in 0.637s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-quobyte-0a0d4a48-da6d-411b-8971-0acf51992e4b" released by "_copy_volume_from_snapshot" :: held 9.525s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-quobyte-a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39-0a0d4a48-da6d-411b-8971-0acf51992e4b" released by "_create_volume_from_snapshot" :: held 9.577s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.602s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd570cf8-479d-45c6-a8d2-8ade2749e064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a0d4a48-da6d-411b-8971-0acf51992e4b', 'volume_size': 1, 'snapshot_id': 'a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1e8e3a-a9e0-4b6f-8f35-a6186589166a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:46 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Volume volume-0a0d4a48-da6d-411b-8971-0acf51992e4b (0a0d4a48-da6d-411b-8971-0acf51992e4b): created successfully Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1e8e3a-a9e0-4b6f-8f35-a6186589166a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Flow 'volume_create_manager' (62eed45e-2f18-466c-9fc1-ab7e4772ca6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:34:46 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-2b8eb6b2-a1cb-4a41-9ec2-fe095f9c7349 tempest-VolumeDependencyTests-488151126 None] Created volume successfully. Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "cinder-a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "cinder-quobyte-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-quobyte-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "cinder-quobyte-a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-quobyte-a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Deleting offline snapshot a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 of volume 00be3b7d-f0f7-4692-b3b0-5f7a70a9abed {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] snapshot_file for this snap is: volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[076068fe-4d1f-4207-a0ea-2a8af0c52cf0]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:46 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 Jun 04 13:34:46 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:47 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39" returned: 0 in 0.807s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:34:47 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[879e28f6-0092-4b57-930c-39e4a7111b13]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:47 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed Jun 04 13:34:47 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:48 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" returned: 0 in 0.816s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:48 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 Jun 04 13:34:48 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:49 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39" returned: 0 in 1.071s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:49 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39 Jun 04 13:34:49 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:50 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed.a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39" returned: 0 in 0.676s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-quobyte-a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39" released by "_delete_snapshot" :: held 3.499s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-quobyte-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" released by "delete_snapshot" :: held 3.534s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:50 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Created reservations ['8ce512d2-cbdb-430e-9436-0cb510328a76', '72dce9bb-23c4-4fca-b012-5d0d61df9c4c', 'ccdd3bb1-85bf-438a-906d-a4a5d47d9353', '02798490-d91d-42c3-85e6-dab946485df4'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:34:50 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Delete snapshot completed successfully. Jun 04 13:34:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d146d126-0aaa-43d0-9b26-d74fc6135172 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-a1dbb3ef-a98b-4c5c-9f78-8dab8782ae39-delete_snapshot" released by "delete_snapshot" :: held 3.703s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Acquiring lock "cinder-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Lock "cinder-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Acquiring lock "cinder-quobyte-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Lock "cinder-quobyte-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" acquired by "delete_volume" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:51 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9641c9-c414-41e0-8503-7412f0fb91ab]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:51 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed Jun 04 13:34:51 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:52 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" returned: 0 in 0.923s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:52 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed Jun 04 13:34:52 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:52 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" returned: 0 in 0.825s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Lock "cinder-quobyte-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed" released by "delete_volume" :: held 1.832s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:52 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Created reservations ['1a259210-7121-463b-be00-aa4cf70078af', '259e3916-8f58-45d2-99ef-e040fa7d0622', '7fdf7995-0cc0-49b9-800f-0b77573b8f4e', 'cae75d5b-19d2-4158-b1e7-c856a65a0f2e'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:53 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:34:53 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "cinder-0a0d4a48-da6d-411b-8971-0acf51992e4b-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-0a0d4a48-da6d-411b-8971-0acf51992e4b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "cinder-quobyte-0a0d4a48-da6d-411b-8971-0acf51992e4b" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-quobyte-0a0d4a48-da6d-411b-8971-0acf51992e4b" acquired by "delete_volume" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[e482dfdc-d8d8-41e1-ab38-4982e0df415b]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:53 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b Jun 04 13:34:53 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:53 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.893s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:34:53 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Deleted volume successfully. Jun 04 13:34:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-8edbe80f-66ab-411c-b52a-e6c18c29213a tempest-VolumeDependencyTests-488151126 None] Lock "cinder-00be3b7d-f0f7-4692-b3b0-5f7a70a9abed-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Flow 'volume_create_manager' (f4e23621-2ec7-4998-89c4-e55250f2897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ddda87-4876-4eb1-89fd-0007375cce38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ddda87-4876-4eb1-89fd-0007375cce38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-733590279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57eff9f-2416-4b1a-a9ac-36817866ae76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e7ef8f0ef24f02bddbe54ace216954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:34:54Z,use_quota=True,user_id='dba816907be14da3bdb341859c2b56a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93230670-6ab9-4b9a-8a76-5d38842db242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93230670-6ab9-4b9a-8a76-5d38842db242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62fac46-c0a4-444e-94f7-12313bfa1572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62fac46-c0a4-444e-94f7-12313bfa1572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd57eff9f-2416-4b1a-a9ac-36817866ae76', 'volume_name': 'volume-d57eff9f-2416-4b1a-a9ac-36817866ae76', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459cbde8-c8e7-491a-abe1-e48160a3293d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459cbde8-c8e7-491a-abe1-e48160a3293d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8855da14-7b29-4001-9d0c-2e42a05670ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:54 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Volume d57eff9f-2416-4b1a-a9ac-36817866ae76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d57eff9f-2416-4b1a-a9ac-36817866ae76', 'volume_size': 1} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-733590279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57eff9f-2416-4b1a-a9ac-36817866ae76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e7ef8f0ef24f02bddbe54ace216954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:34:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:34:54Z,use_quota=True,user_id='dba816907be14da3bdb341859c2b56a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Creating volume d57eff9f-2416-4b1a-a9ac-36817866ae76 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:34:54 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:54 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 1073741824 Jun 04 13:34:54 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:54 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b" returned: 0 in 0.872s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:54 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b Jun 04 13:34:54 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:54 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0a0d4a48-da6d-411b-8971-0acf51992e4b" returned: 0 in 0.627s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-quobyte-0a0d4a48-da6d-411b-8971-0acf51992e4b" released by "delete_volume" :: held 1.571s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Created reservations ['8eb930be-1042-40ac-98b2-d735e04f3989', '4726068e-3436-46bd-a8a9-da2644f187f6', 'b4d408ca-8f76-44af-8ab9-8b9803eb288c', '7bc8a2c7-adba-4fea-89fc-73f6decd8374'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:34:54 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 1073741824" returned: 0 in 0.819s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:55 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 Jun 04 13:34:55 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:55 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:34:55 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:55 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76" returned: 0 in 0.626s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8855da14-7b29-4001-9d0c-2e42a05670ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d57eff9f-2416-4b1a-a9ac-36817866ae76', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29beecdc-aeed-401a-9f94-606a0b0b7c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:34:55 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Volume volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 (d57eff9f-2416-4b1a-a9ac-36817866ae76): created successfully Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29beecdc-aeed-401a-9f94-606a0b0b7c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:34:55 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Flow 'volume_create_manager' (f4e23621-2ec7-4998-89c4-e55250f2897b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.641s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:34:55 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Deleted volume successfully. Jun 04 13:34:55 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-bab22ea4-048c-49f2-a4a7-3cb86489116b tempest-SnapshotDependencyTests-1549234151 None] Created volume successfully. Jun 04 13:34:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a9f73934-067c-4d7b-b8f3-935343d08679 tempest-VolumeDependencyTests-488151126 None] Lock "cinder-0a0d4a48-da6d-411b-8971-0acf51992e4b-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:56 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] Creating offline snapshot b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 of volume d57eff9f-2416-4b1a-a9ac-36817866ae76 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:34:56 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[0025dad3-bc2a-4cb1-b68d-68372c786856]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Acquiring lock "cinder-0b7de273-fc88-4534-a45b-ce060024fd10-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Lock "cinder-0b7de273-fc88-4534-a45b-ce060024fd10-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Acquiring lock "cinder-quobyte-0b7de273-fc88-4534-a45b-ce060024fd10" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Lock "cinder-quobyte-0b7de273-fc88-4534-a45b-ce060024fd10" acquired by "delete_volume" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:56 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 Jun 04 13:34:56 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:56 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4aae9a-18b0-4f95-a04d-9cf95bb1e656]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:56 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 Jun 04 13:34:56 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:57 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76" returned: 0 in 0.902s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:57 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 1G Jun 04 13:34:57 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:57 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10" returned: 0 in 0.779s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:57 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10 Jun 04 13:34:57 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:58 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b7de273-fc88-4534-a45b-ce060024fd10" returned: 0 in 0.667s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Lock "cinder-quobyte-0b7de273-fc88-4534-a45b-ce060024fd10" released by "delete_volume" :: held 1.508s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:58 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Created reservations ['f83fb2e8-7796-4042-a263-036663c33b4c', '5bff88a8-ef26-4798-9d3b-2f5c1d61de6c', 'ae5f8e51-b8a3-48c8-983a-d76a769ffad2', '078a06cd-9b72-4c49-b3ac-eb4f266f94b9'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:34:58 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 1G" returned: 0 in 0.875s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:58 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 Jun 04 13:34:58 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:34:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:34:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:34:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:34:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:34:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:58 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:34:58 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:59 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3" returned: 0 in 0.716s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:59 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 is being set with open permissions: ugo+rw Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:59 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.706s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:34:59 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 Jun 04 13:34:59 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:59 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Deleted volume successfully. Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf446567-b2a4-49b2-abed-d21ef1cafd04 tempest-TestStampPattern-1763623516 None] Lock "cinder-0b7de273-fc88-4534-a45b-ce060024fd10-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Acquiring lock "cinder-d8cafc70-eddd-44cc-8405-e898db98d4f7-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Lock "cinder-d8cafc70-eddd-44cc-8405-e898db98d4f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Acquiring lock "cinder-quobyte-944c0ffe-506b-4cdc-842f-2d213320cd13" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Lock "cinder-quobyte-944c0ffe-506b-4cdc-842f-2d213320cd13" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Acquiring lock "cinder-quobyte-d8cafc70-eddd-44cc-8405-e898db98d4f7" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Lock "cinder-quobyte-d8cafc70-eddd-44cc-8405-e898db98d4f7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Deleting offline snapshot d8cafc70-eddd-44cc-8405-e898db98d4f7 of volume 944c0ffe-506b-4cdc-842f-2d213320cd13 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] snapshot_file for this snap is: volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1b51dd-6e86-4ce3-8f82-39d09f77db28]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:59 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 Jun 04 13:34:59 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:34:59 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3" returned: 0 in 0.817s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:34:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:34:59 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.info Jun 04 13:34:59 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:00 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7" returned: 0 in 0.783s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-944c0ffe-506b-4cdc-842f-2d213320cd13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:35:00 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e86feb1-5ba4-4043-a024-cf9fd65d486e]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:00 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 Jun 04 13:35:00 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:00 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.info" returned: 0 in 0.632s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:00 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.info is being set with open permissions: ugo+rw Jun 04 13:35:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:00 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.info Jun 04 13:35:00 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:01 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13" returned: 0 in 0.757s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:01 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 Jun 04 13:35:01 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:01 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.info" returned: 0 in 0.593s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.703s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:01 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-91be4772-6df6-4ab8-91c6-159aa502c63d tempest-SnapshotDependencyTests-1549234151 None] Create snapshot completed successfully Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Flow 'volume_create_manager' (0b500b5e-2ec0-4140-b46a-86c9a426e4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530f9934-2e40-4dbc-87a5-40b9a2a440ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530f9934-2e40-4dbc-87a5-40b9a2a440ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca94510d-ddaf-4219-b612-2181fdfabb73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ba8987b3e143d9bda89bdf30d6a80a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:01Z,use_quota=True,user_id='f4736d46015b418ab1547997bfb667ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f882ef68-6e99-4202-ad45-80f24f350d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f882ef68-6e99-4202-ad45-80f24f350d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa616a50-e076-406f-a79e-351088702e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.image.glance [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Creating Keystone auth plugin from conf {{(pid=86722) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa616a50-e076-406f-a79e-351088702e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ca94510d-ddaf-4219-b612-2181fdfabb73', 'volume_name': 'volume-ca94510d-ddaf-4219-b612-2181fdfabb73', 'volume_size': 1, 'image_id': 'b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6952e195672e681f0b5dac6716952a55', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3ba8987b3e143d9bda89bdf30d6a80a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b95de4e14f10823d4c301a9e637b3e68f40a044df6f804edc68699e931ad18d336245d17de9c438f9d3d7acf0ab4cc7a2cf2558f0ae7d7cf9d5ee6b54af08100', 'id': 'b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'created_at': datetime.datetime(2026, 6, 4, 11, 34, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 35, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b66a4425-5dc6-4f92-bfba-3b86e183ebce/file', 'properties': {}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7941fc2d-b3e6-428e-8308-d4b54fa4805f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7941fc2d-b3e6-428e-8308-d4b54fa4805f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e379bd7-f649-4cbd-a6ab-ac51c9caeeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:01 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Volume ca94510d-ddaf-4219-b612-2181fdfabb73: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ca94510d-ddaf-4219-b612-2181fdfabb73', 'volume_size': 1, 'image_id': 'b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6952e195672e681f0b5dac6716952a55', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3ba8987b3e143d9bda89bdf30d6a80a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b95de4e14f10823d4c301a9e637b3e68f40a044df6f804edc68699e931ad18d336245d17de9c438f9d3d7acf0ab4cc7a2cf2558f0ae7d7cf9d5ee6b54af08100', 'id': 'b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'created_at': datetime.datetime(2026, 6, 4, 11, 34, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 35, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b66a4425-5dc6-4f92-bfba-3b86e183ebce/file', 'properties': {}}, 'image_service': } Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Trying to clone ca94510d-ddaf-4219-b612-2181fdfabb73 from image b66a4425-5dc6-4f92-bfba-3b86e183ebce at location (None, [{'url': 'file:///opt/stack/data/glance/images/b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'metadata': {}}]). {{(pid=86722) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 13:35:01 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7" returned: 0 in 0.767s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:01 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7 Jun 04 13:35:01 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 13:35:01 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Image download 0.00 MB at 0.00 MB/s Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a44065-880e-404b-82b5-8e8105f2f583]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:02 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD Jun 04 13:35:02 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Flow 'volume_create_manager' (b1027d2e-7076-4c74-9875-5c5ca0b9b5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a110f7-9862-4e20-bc3f-a1f67f5fce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a110f7-9862-4e20-bc3f-a1f67f5fce49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc76286b-e5f9-47d2-94c3-8cfc7681487c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e7ef8f0ef24f02bddbe54ace216954',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:02Z,use_quota=True,user_id='dba816907be14da3bdb341859c2b56a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d1d999-cee1-4be5-a644-8afeea3b4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d1d999-cee1-4be5-a644-8afeea3b4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468af8a5-9824-487b-abf1-0c0a62827a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468af8a5-9824-487b-abf1-0c0a62827a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fc76286b-e5f9-47d2-94c3-8cfc7681487c', 'volume_name': 'volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c', 'volume_size': 1, 'snapshot_id': 'b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caefcf3-4e7f-4643-921b-dd919a97e504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caefcf3-4e7f-4643-921b-dd919a97e504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b45341-8a13-40f8-ab54-c088da122e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:02 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Volume fc76286b-e5f9-47d2-94c3-8cfc7681487c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c', 'volume_size': 1, 'snapshot_id': 'b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3'} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "cinder-quobyte-b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3-fc76286b-e5f9-47d2-94c3-8cfc7681487c" by "_create_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-quobyte-b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3-fc76286b-e5f9-47d2-94c3-8cfc7681487c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Creating volume fc76286b-e5f9-47d2-94c3-8cfc7681487c from snapshot b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 {{(pid=86722) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "cinder-quobyte-fc76286b-e5f9-47d2-94c3-8cfc7681487c" by "_copy_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-quobyte-fc76286b-e5f9-47d2-94c3-8cfc7681487c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] snapshot: b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3, volume: fc76286b-e5f9-47d2-94c3-8cfc7681487c, {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44e661c-2387-4134-93c1-9ef894a31859]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:02 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13.d8cafc70-eddd-44cc-8405-e898db98d4f7" returned: 0 in 0.646s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Lock "cinder-quobyte-d8cafc70-eddd-44cc-8405-e898db98d4f7" released by "_delete_snapshot" :: held 3.083s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Lock "cinder-quobyte-944c0ffe-506b-4cdc-842f-2d213320cd13" released by "delete_snapshot" :: held 3.115s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:02 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 Jun 04 13:35:02 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Created reservations ['41cd54cf-546f-4bd3-9d1b-85f610addbe4', '7c2b508f-9631-40fa-a800-79ed870c723d', 'acfe0694-c9aa-4456-9c37-42f8aca919ff', '095cf088-181a-445a-b9db-cb94d0bb7e1c'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:35:02 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Delete snapshot completed successfully. Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3b943cbe-b861-4230-bb92-b1b1e1129b1a tempest-TestStampPattern-1763623516 None] Lock "cinder-d8cafc70-eddd-44cc-8405-e898db98d4f7-delete_snapshot" released by "delete_snapshot" :: held 3.274s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:02 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:02 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD Jun 04 13:35:02 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:03 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3" returned: 0 in 0.738s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d57eff9f-2416-4b1a-a9ac-36817866ae76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Creating direct copy from snapshot {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf621c3-2fb7-431c-867c-4c1eeaa9326b]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:03 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 Jun 04 13:35:03 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:03 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD" returned: 1 in 0.690s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Temporary image b66a4425-5dc6-4f92-bfba-3b86e183ebce is fetched for user f4736d46015b418ab1547997bfb667ab. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d36f5e1-ed81-4910-8bde-bc855cc30d1b]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:03 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD Jun 04 13:35:03 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:03 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76" returned: 0 in 0.759s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG cinder.utils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Path /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c not found in is_blk_device check {{(pid=86722) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 13:35:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:04 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c Jun 04 13:35:04 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:35:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:04 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:35:04 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:04 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:04 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD Jun 04 13:35:04 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:04 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.927s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:35:05 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:35:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:35:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:35:05 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD" returned: 1 in 1.026s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:35:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:10 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c" returned: 0 in 6.050s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:10 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cc3050-5afd-47bd-a1fe-42ed9380ec97]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:10 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 Jun 04 13:35:10 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:10 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76" returned: 0 in 0.895s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:10 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:35:10 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Converted 1024.00 MB image at 169.21 MB/s Jun 04 13:35:10 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c is being set with open permissions: ugo+rw Jun 04 13:35:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:10 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c Jun 04 13:35:10 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:11 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c" returned: 0 in 0.628s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-quobyte-fc76286b-e5f9-47d2-94c3-8cfc7681487c" released by "_copy_volume_from_snapshot" :: held 9.196s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-quobyte-b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3-fc76286b-e5f9-47d2-94c3-8cfc7681487c" released by "_create_volume_from_snapshot" :: held 9.226s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.243s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.310s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca94510d-ddaf-4219-b612-2181fdfabb73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ba8987b3e143d9bda89bdf30d6a80a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:01Z,use_quota=True,user_id='f4736d46015b418ab1547997bfb667ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Creating volume ca94510d-ddaf-4219-b612-2181fdfabb73 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:35:11 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=72,cinder:INSERT=16,cinder:UPDATE=71,cinder:DELETE=6 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:35:11 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 1073741824 Jun 04 13:35:11 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=69,cinder:SELECT=68,cinder:INSERT=28,cinder:DELETE=5 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b45341-8a13-40f8-ab54-c088da122e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c', 'volume_size': 1, 'snapshot_id': 'b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd203e4-c64e-40e8-a2c2-7626c5be3f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:11 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Volume volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c (fc76286b-e5f9-47d2-94c3-8cfc7681487c): created successfully Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd203e4-c64e-40e8-a2c2-7626c5be3f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:11 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Flow 'volume_create_manager' (b1027d2e-7076-4c74-9875-5c5ca0b9b5e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:11 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-567290d7-7492-42ce-be30-a349f7668e9a tempest-SnapshotDependencyTests-1549234151 None] Created volume successfully. Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "cinder-b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "cinder-quobyte-d57eff9f-2416-4b1a-a9ac-36817866ae76" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Acquiring lock "cinder-944c0ffe-506b-4cdc-842f-2d213320cd13-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-quobyte-d57eff9f-2416-4b1a-a9ac-36817866ae76" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "cinder-quobyte-b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Lock "cinder-944c0ffe-506b-4cdc-842f-2d213320cd13-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-quobyte-b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Deleting offline snapshot b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 of volume d57eff9f-2416-4b1a-a9ac-36817866ae76 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] snapshot_file for this snap is: volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:35:12 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 1073741824" returned: 0 in 0.859s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d46c7d-897e-452f-98f6-467d962b6a04]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Acquiring lock "cinder-quobyte-944c0ffe-506b-4cdc-842f-2d213320cd13" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Lock "cinder-quobyte-944c0ffe-506b-4cdc-842f-2d213320cd13" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfc5125-4d0d-49be-9730-54d8684a1e92]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:12 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 Jun 04 13:35:12 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:12 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 Jun 04 13:35:12 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:12 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 Jun 04 13:35:12 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:13 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73" returned: 0 in 0.606s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Attempting download of b66a4425-5dc6-4f92-bfba-3b86e183ebce ((None, [{'url': 'file:///opt/stack/data/glance/images/b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'metadata': {}}])) to volume ca94510d-ddaf-4219-b612-2181fdfabb73. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 13:35:13 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3" returned: 0 in 0.782s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d57eff9f-2416-4b1a-a9ac-36817866ae76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd20ccdc-a175-4cac-a4f1-2a564f294f3b]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b66a4425-5dc6-4f92-bfba-3b86e183ebce__ppp76ur {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d45daa-6bfc-4ccf-8fed-17b199098323]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:13 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13" returned: 0 in 0.761s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:13 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13 Jun 04 13:35:13 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:13 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b66a4425-5dc6-4f92-bfba-3b86e183ebce__ppp76ur Jun 04 13:35:13 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:13 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 Jun 04 13:35:13 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:13 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-944c0ffe-506b-4cdc-842f-2d213320cd13" returned: 0 in 0.630s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:13 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Lock "cinder-quobyte-944c0ffe-506b-4cdc-842f-2d213320cd13" released by "delete_volume" :: held 1.451s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:14 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b66a4425-5dc6-4f92-bfba-3b86e183ebce__ppp76ur" returned: 0 in 0.729s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b66a4425-5dc6-4f92-bfba-3b86e183ebce__ppp76ur {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:14 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Created reservations ['ba918057-0e95-4500-8e47-23096b45be73', 'bf58f0e0-ffb5-4f85-ab7d-5e82ffa8032b', '39523228-e619-4715-8d78-296386db6567', 'c30ab631-5ec7-4f19-b16a-63df73ee0773'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76" returned: 0 in 0.743s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:14 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 Jun 04 13:35:14 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:14 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b66a4425-5dc6-4f92-bfba-3b86e183ebce__ppp76ur Jun 04 13:35:14 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:14 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:35:14 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:14 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b66a4425-5dc6-4f92-bfba-3b86e183ebce__ppp76ur" returned: 1 in 0.747s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b66a4425-5dc6-4f92-bfba-3b86e183ebce__ppp76ur' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48cc6ae-2708-4d93-9489-f855a72a6528]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:14 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.668s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:35:14 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3" returned: 0 in 0.773s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:14 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Deleted volume successfully. Jun 04 13:35:14 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3 Jun 04 13:35:14 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:14 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-de04be44-372c-4d09-b389-0b07d7f2df35 tempest-TestStampPattern-1763623516 None] Lock "cinder-944c0ffe-506b-4cdc-842f-2d213320cd13-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:14 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD Jun 04 13:35:14 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:15 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:15 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:15 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76.b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3" returned: 0 in 0.718s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-quobyte-b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3" released by "_delete_snapshot" :: held 3.166s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-quobyte-d57eff9f-2416-4b1a-a9ac-36817866ae76" released by "delete_snapshot" :: held 3.207s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:15 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD Jun 04 13:35:15 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:15 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Created reservations ['fc610917-a504-4964-a655-3583e5140ef9', 'bf7c86c9-5a09-46ce-814f-c001da25478a', '142f9218-fb81-468e-a2f0-9120f246f6eb', 'f53d9e49-138f-471c-bf6f-f968cb8b23ff'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:35:15 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Delete snapshot completed successfully. Jun 04 13:35:15 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a0308341-7a95-46c4-8e23-55ff12ae9ad6 tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-b2c0d8bf-916a-4c8d-865b-3febaf1bb5c3-delete_snapshot" released by "delete_snapshot" :: held 3.397s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:16 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD" returned: 1 in 0.706s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:35:16 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] b66a4425-5dc6-4f92-bfba-3b86e183ebce was raw, converting to raw {{(pid=86722) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 13:35:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:16 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 Jun 04 13:35:16 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "cinder-d57eff9f-2416-4b1a-a9ac-36817866ae76-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-d57eff9f-2416-4b1a-a9ac-36817866ae76-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "cinder-quobyte-d57eff9f-2416-4b1a-a9ac-36817866ae76" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:16 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-quobyte-d57eff9f-2416-4b1a-a9ac-36817866ae76" acquired by "delete_volume" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:16 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2c106c-810b-48de-9919-55b760a2e788]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:16 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:16 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 Jun 04 13:35:16 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:16 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73" returned: 0 in 0.787s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:17 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b66a4425-5dc6-4f92-bfba-3b86e183ebce_9c1wauqndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:35:17 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Converted 0.00 MB image at 0.00 MB/s Jun 04 13:35:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:17 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 1G Jun 04 13:35:17 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:17 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76" returned: 0 in 0.753s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:17 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76 Jun 04 13:35:17 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:17 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 1G" returned: 0 in 0.663s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:17 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0d2b9a-ef3b-48e2-a5ee-3bb5266234a9]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:17 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:17 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 Jun 04 13:35:17 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:18 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d57eff9f-2416-4b1a-a9ac-36817866ae76" returned: 0 in 0.815s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-quobyte-d57eff9f-2416-4b1a-a9ac-36817866ae76" released by "delete_volume" :: held 1.659s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Created reservations ['9b8f8a8f-a39d-4b2e-9913-c4de202af794', 'a646887b-10ae-41b7-8058-a05fbfcf9ee8', '5c3dd14f-15c6-4355-8b00-a748c476bc53', '582ad859-9ed4-4726-869e-ab74cbe45d2a'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:18 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:35:18 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:18 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73" returned: 0 in 0.832s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:18 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 Jun 04 13:35:18 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "cinder-fc76286b-e5f9-47d2-94c3-8cfc7681487c-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:18 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-fc76286b-e5f9-47d2-94c3-8cfc7681487c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "cinder-quobyte-fc76286b-e5f9-47d2-94c3-8cfc7681487c" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-quobyte-fc76286b-e5f9-47d2-94c3-8cfc7681487c" acquired by "delete_volume" :: waited 0.026s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[e365c1a5-f353-4292-942c-ec1ebace7957]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:19 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.703s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:35:19 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Deleted volume successfully. Jun 04 13:35:19 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c Jun 04 13:35:19 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0bbda707-654a-4bca-a2de-d4c1f601360e tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-d57eff9f-2416-4b1a-a9ac-36817866ae76-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:19 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73" returned: 1 in 0.860s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Downloaded image b66a4425-5dc6-4f92-bfba-3b86e183ebce ((None, [{'url': 'file:///opt/stack/data/glance/images/b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'metadata': {}}])) to volume ca94510d-ddaf-4219-b612-2181fdfabb73 successfully. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Temporary image b66a4425-5dc6-4f92-bfba-3b86e183ebce for user f4736d46015b418ab1547997bfb667ab is deleted. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Marking volume ca94510d-ddaf-4219-b612-2181fdfabb73 as bootable. {{(pid=86722) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Copying metadata from image b66a4425-5dc6-4f92-bfba-3b86e183ebce to ca94510d-ddaf-4219-b612-2181fdfabb73. {{(pid=86722) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Creating volume glance metadata for volume ca94510d-ddaf-4219-b612-2181fdfabb73 backed by image b66a4425-5dc6-4f92-bfba-3b86e183ebce with: {'image_id': 'b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6952e195672e681f0b5dac6716952a55', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86722) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e379bd7-f649-4cbd-a6ab-ac51c9caeeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca94510d-ddaf-4219-b612-2181fdfabb73', 'volume_size': 1, 'image_id': 'b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6952e195672e681f0b5dac6716952a55', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3ba8987b3e143d9bda89bdf30d6a80a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b95de4e14f10823d4c301a9e637b3e68f40a044df6f804edc68699e931ad18d336245d17de9c438f9d3d7acf0ab4cc7a2cf2558f0ae7d7cf9d5ee6b54af08100', 'id': 'b66a4425-5dc6-4f92-bfba-3b86e183ebce', 'created_at': datetime.datetime(2026, 6, 4, 11, 34, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 35, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b66a4425-5dc6-4f92-bfba-3b86e183ebce/file', 'properties': {}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40418719-b2bb-40c2-993c-7344df40a6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:19 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Volume volume-ca94510d-ddaf-4219-b612-2181fdfabb73 (ca94510d-ddaf-4219-b612-2181fdfabb73): created successfully Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40418719-b2bb-40c2-993c-7344df40a6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Flow 'volume_create_manager' (0b500b5e-2ec0-4140-b46a-86c9a426e4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:19 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-928e0568-0255-449d-809d-73c5080b3e1a tempest-VolumeImageDependencyTests-852404708 None] Created volume successfully. Jun 04 13:35:19 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c" returned: 0 in 0.809s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:19 devstack sudo[104492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c Jun 04 13:35:19 devstack sudo[104492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Acquiring lock "cinder-ca94510d-ddaf-4219-b612-2181fdfabb73-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Lock "cinder-ca94510d-ddaf-4219-b612-2181fdfabb73-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Acquiring lock "cinder-quobyte-ca94510d-ddaf-4219-b612-2181fdfabb73" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Lock "cinder-quobyte-ca94510d-ddaf-4219-b612-2181fdfabb73" acquired by "delete_volume" :: waited 0.033s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ca1e80-3efb-4fd8-b540-38c6086e5105]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:20 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 Jun 04 13:35:20 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:20 devstack sudo[104492]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fc76286b-e5f9-47d2-94c3-8cfc7681487c" returned: 0 in 0.669s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-quobyte-fc76286b-e5f9-47d2-94c3-8cfc7681487c" released by "delete_volume" :: held 1.530s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Created reservations ['a9d016f5-1154-4715-831f-6dcb6ed862be', '0c26c24a-12cf-4767-b4ae-87b55a0f485d', '78b4bc69-562b-4aa2-943e-8f0c802e0414', '706f9b12-ff3d-4cba-a6da-0739dbd2b604'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:20 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:35:20 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:21 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73" returned: 0 in 0.800s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:21 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 Jun 04 13:35:21 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:21 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.659s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:21 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:35:21 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Deleted volume successfully. Jun 04 13:35:21 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5113547b-eda0-4560-b024-e3d768eb33c5 tempest-SnapshotDependencyTests-1549234151 None] Lock "cinder-fc76286b-e5f9-47d2-94c3-8cfc7681487c-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:21 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73" returned: 1 in 0.831s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:35:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:21 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73 Jun 04 13:35:21 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:22 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca94510d-ddaf-4219-b612-2181fdfabb73" returned: 0 in 0.696s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:22 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Lock "cinder-quobyte-ca94510d-ddaf-4219-b612-2181fdfabb73" released by "delete_volume" :: held 2.401s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:22 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Created reservations ['6ccd1903-8637-4b25-b1a6-93bd870a8313', '8448f9fe-4ae3-492a-be03-7b0de835c525', 'a1e37c6a-55ab-44cd-adba-71a832f9cb76', '0e9e616d-ae48-4ec6-a4ea-8b9f37c2df37'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:35:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:22 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:35:22 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:23 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.654s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:23 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:35:23 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Deleted volume successfully. Jun 04 13:35:23 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ea2b8b8-c7f3-4345-8f64-124f3102417a tempest-VolumeImageDependencyTests-852404708 None] Lock "cinder-ca94510d-ddaf-4219-b612-2181fdfabb73-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Flow 'volume_create_manager' (5e395df3-6b51-4baa-a816-7a78a79c798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48501b3f-a5ee-464e-b664-aeb98f9252bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48501b3f-a5ee-464e-b664-aeb98f9252bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1329443178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac46eb6-1441-49ee-949b-eb64dad56e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c362626a8704da69236dbe87a890c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:26Z,use_quota=True,user_id='31e11193b9eb4f71a325e9f046eaef24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98084fa-5239-4272-8d2b-5381510d555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98084fa-5239-4272-8d2b-5381510d555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318d2279-908c-4041-813b-d5035e700ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318d2279-908c-4041-813b-d5035e700ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac46eb6-1441-49ee-949b-eb64dad56e8e', 'volume_name': 'volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c05410-288b-4a26-95ea-45815121094a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c05410-288b-4a26-95ea-45815121094a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6b319c-eb72-4c18-b192-34fbc63c877c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:26 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume 3ac46eb6-1441-49ee-949b-eb64dad56e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e', 'volume_size': 1} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1329443178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac46eb6-1441-49ee-949b-eb64dad56e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c362626a8704da69236dbe87a890c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:26Z,use_quota=True,user_id='31e11193b9eb4f71a325e9f046eaef24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Creating volume 3ac46eb6-1441-49ee-949b-eb64dad56e8e {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:35:26 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:35:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:26 devstack sudo[104517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e 1073741824 Jun 04 13:35:26 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:27 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e 1073741824" returned: 0 in 0.807s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:27 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e Jun 04 13:35:27 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:27 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e" returned: 0 in 0.625s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:35:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6b319c-eb72-4c18-b192-34fbc63c877c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b47a3a9-682b-4044-8c8b-9c6a635ea10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:28 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e (3ac46eb6-1441-49ee-949b-eb64dad56e8e): created successfully Jun 04 13:35:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b47a3a9-682b-4044-8c8b-9c6a635ea10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Flow 'volume_create_manager' (5e395df3-6b51-4baa-a816-7a78a79c798d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:28 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-12f652aa-08f5-4b86-87a4-ce4c4d54de0e tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Created volume successfully. Jun 04 13:35:28 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:35:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Flow 'volume_create_manager' (5f6413ca-47f1-4abd-ab3d-707c25d2804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5b8a9a-811b-4761-9df4-8ff7049b6867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5b8a9a-811b-4761-9df4-8ff7049b6867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-536537657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a7144d-cba6-4e4f-82d1-939aee289ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c362626a8704da69236dbe87a890c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:29Z,use_quota=True,user_id='31e11193b9eb4f71a325e9f046eaef24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59dd2b7-14aa-4106-8b21-7c3aa15cde2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59dd2b7-14aa-4106-8b21-7c3aa15cde2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9785e77f-79ac-4190-85d1-082e5d157d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9785e77f-79ac-4190-85d1-082e5d157d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09a7144d-cba6-4e4f-82d1-939aee289ea9', 'volume_name': 'volume-09a7144d-cba6-4e4f-82d1-939aee289ea9', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c42df0d-6fcd-4a30-94d1-06d7079fc312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c42df0d-6fcd-4a30-94d1-06d7079fc312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67379ec6-e89f-478d-aefd-9110bbe154d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume 09a7144d-cba6-4e4f-82d1-939aee289ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09a7144d-cba6-4e4f-82d1-939aee289ea9', 'volume_size': 1} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-536537657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a7144d-cba6-4e4f-82d1-939aee289ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c362626a8704da69236dbe87a890c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:29Z,use_quota=True,user_id='31e11193b9eb4f71a325e9f046eaef24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Creating volume 09a7144d-cba6-4e4f-82d1-939aee289ea9 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:35:29 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-09a7144d-cba6-4e4f-82d1-939aee289ea9 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:29 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-09a7144d-cba6-4e4f-82d1-939aee289ea9 1073741824 Jun 04 13:35:29 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Flow 'volume_create_manager' (e3e019ff-23e1-4af6-bc53-0488480d01db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b40cc2d-f084-4d62-b733-d10ef56f2e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b40cc2d-f084-4d62-b733-d10ef56f2e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482661451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00be6a6-14a0-4d62-8c51-b97276ce74a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c362626a8704da69236dbe87a890c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:29Z,use_quota=True,user_id='31e11193b9eb4f71a325e9f046eaef24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ea5d09-9c01-46d8-83d8-56fc010d2e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ea5d09-9c01-46d8-83d8-56fc010d2e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f78bb1-b235-4982-921d-2e74ac43f033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f78bb1-b235-4982-921d-2e74ac43f033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e00be6a6-14a0-4d62-8c51-b97276ce74a5', 'volume_name': 'volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80919142-ff08-4ea1-8401-8e89e4a1825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80919142-ff08-4ea1-8401-8e89e4a1825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0fcafd1-58dd-4a5f-9871-8d01fb1ebb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume e00be6a6-14a0-4d62-8c51-b97276ce74a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5', 'volume_size': 1} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Flow 'volume_create_manager' (c2dddc17-7ee5-4f1b-b6e6-e00a07bc8bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d8d0ec-3a46-4f0a-b5dd-269275f414c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d8d0ec-3a46-4f0a-b5dd-269275f414c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774781738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5deaab-e34c-46e5-a488-aacc3a9d1bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c362626a8704da69236dbe87a890c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:30Z,use_quota=True,user_id='31e11193b9eb4f71a325e9f046eaef24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8311be-ba3a-469f-8950-1de803735d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8311be-ba3a-469f-8950-1de803735d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a026be6f-5d7b-4f98-b52d-a00ffc287b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a026be6f-5d7b-4f98-b52d-a00ffc287b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb5deaab-e34c-46e5-a488-aacc3a9d1bf2', 'volume_name': 'volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c9db00-5b4f-4c7b-af92-21cd14d90f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c9db00-5b4f-4c7b-af92-21cd14d90f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f72aa82-d14c-4498-9e64-8c4a31b47039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:29 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume fb5deaab-e34c-46e5-a488-aacc3a9d1bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2', 'volume_size': 1} Jun 04 13:35:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:30 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-09a7144d-cba6-4e4f-82d1-939aee289ea9 1073741824" returned: 0 in 1.041s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Flow 'volume_create_manager' (bdd5e40c-c019-4a58-8395-7129787ed5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96574b3b-d4e3-4ad6-bda3-d5735f15dcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96574b3b-d4e3-4ad6-bda3-d5735f15dcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1540643978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2de67d-3bff-4c6d-a8ff-1f5571c51558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c362626a8704da69236dbe87a890c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:30Z,use_quota=True,user_id='31e11193b9eb4f71a325e9f046eaef24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ebd371-bb25-47ff-ad84-5e93e9edfdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ebd371-bb25-47ff-ad84-5e93e9edfdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c12b6f-b6a7-4ba4-8279-5992703bfad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c12b6f-b6a7-4ba4-8279-5992703bfad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2de67d-3bff-4c6d-a8ff-1f5571c51558', 'volume_name': 'volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbe635a-55a4-4219-a351-d0a79d6fa3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbe635a-55a4-4219-a351-d0a79d6fa3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c4f610-0da8-4b32-ae03-29b1abe7dcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:30 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume cf2de67d-3bff-4c6d-a8ff-1f5571c51558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558', 'volume_size': 1} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-09a7144d-cba6-4e4f-82d1-939aee289ea9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:30 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-09a7144d-cba6-4e4f-82d1-939aee289ea9 Jun 04 13:35:30 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Flow 'volume_create_manager' (39c0071b-05f8-4ab7-a414-8c3ac4d00a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5884fb-87d1-4886-8c6b-0666d9f32985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5884fb-87d1-4886-8c6b-0666d9f32985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1576622071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11924e7-a630-49fc-8fbf-cf479378b413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c362626a8704da69236dbe87a890c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:30Z,use_quota=True,user_id='31e11193b9eb4f71a325e9f046eaef24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ceca9f9-ddf1-4efe-b2db-d75b61918153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ceca9f9-ddf1-4efe-b2db-d75b61918153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6670b32-c534-4a61-9bb6-67c5ac43e7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6670b32-c534-4a61-9bb6-67c5ac43e7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c11924e7-a630-49fc-8fbf-cf479378b413', 'volume_name': 'volume-c11924e7-a630-49fc-8fbf-cf479378b413', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bfe3695-db7b-4817-bf3b-2041e5e3c467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bfe3695-db7b-4817-bf3b-2041e5e3c467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899b16dc-ae62-43f7-af14-1181a8821a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:30 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume c11924e7-a630-49fc-8fbf-cf479378b413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c11924e7-a630-49fc-8fbf-cf479378b413', 'volume_size': 1} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:30 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-09a7144d-cba6-4e4f-82d1-939aee289ea9" returned: 0 in 0.690s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482661451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00be6a6-14a0-4d62-8c51-b97276ce74a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c362626a8704da69236dbe87a890c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:29Z,use_quota=True,user_id='31e11193b9eb4f71a325e9f046eaef24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Creating volume e00be6a6-14a0-4d62-8c51-b97276ce74a5 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:35:30 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67379ec6-e89f-478d-aefd-9110bbe154d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a7144d-cba6-4e4f-82d1-939aee289ea9', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:30 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5 1073741824 Jun 04 13:35:30 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbed99a6-b376-4aca-9b99-3304c89c3b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:30 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume volume-09a7144d-cba6-4e4f-82d1-939aee289ea9 (09a7144d-cba6-4e4f-82d1-939aee289ea9): created successfully Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbed99a6-b376-4aca-9b99-3304c89c3b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:30 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Flow 'volume_create_manager' (5f6413ca-47f1-4abd-ab3d-707c25d2804e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:30 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fdc261ac-e3f4-4591-b691-0106bd275370 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Created volume successfully. Jun 04 13:35:31 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5 1073741824" returned: 0 in 0.767s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:31 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5 Jun 04 13:35:31 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:32 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5" returned: 0 in 0.582s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.453s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1774781738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb5deaab-e34c-46e5-a488-aacc3a9d1bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c362626a8704da69236dbe87a890c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:30Z,use_quota=True,user_id='31e11193b9eb4f71a325e9f046eaef24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Creating volume fb5deaab-e34c-46e5-a488-aacc3a9d1bf2 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:35:32 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0fcafd1-58dd-4a5f-9871-8d01fb1ebb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:32 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2 1073741824 Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e58762f-8558-427a-b0e3-dbf88bb2effe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:32 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:32 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5 (e00be6a6-14a0-4d62-8c51-b97276ce74a5): created successfully Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e58762f-8558-427a-b0e3-dbf88bb2effe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Flow 'volume_create_manager' (e3e019ff-23e1-4af6-bc53-0488480d01db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:32 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8b2e8593-75bd-4015-b80c-ccbd99185366 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Created volume successfully. Jun 04 13:35:33 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2 1073741824" returned: 0 in 0.744s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:33 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2 Jun 04 13:35:33 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:33 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2" returned: 0 in 0.580s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.454s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1540643978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2de67d-3bff-4c6d-a8ff-1f5571c51558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c362626a8704da69236dbe87a890c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:30Z,use_quota=True,user_id='31e11193b9eb4f71a325e9f046eaef24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Creating volume cf2de67d-3bff-4c6d-a8ff-1f5571c51558 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:35:33 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f72aa82-d14c-4498-9e64-8c4a31b47039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:33 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558 1073741824 Jun 04 13:35:33 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205f3b16-1731-4de5-9cb2-adabbc183cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:33 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2 (fb5deaab-e34c-46e5-a488-aacc3a9d1bf2): created successfully Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205f3b16-1731-4de5-9cb2-adabbc183cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Flow 'volume_create_manager' (c2dddc17-7ee5-4f1b-b6e6-e00a07bc8bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:33 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a2fc06ce-fb76-413c-bf89-71bd60c920c4 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Created volume successfully. Jun 04 13:35:34 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558 1073741824" returned: 0 in 0.757s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:34 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558 Jun 04 13:35:34 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:35 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558" returned: 0 in 0.591s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.431s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1576622071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c11924e7-a630-49fc-8fbf-cf479378b413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c362626a8704da69236dbe87a890c0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:30Z,use_quota=True,user_id='31e11193b9eb4f71a325e9f046eaef24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Creating volume c11924e7-a630-49fc-8fbf-cf479378b413 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:35:35 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c11924e7-a630-49fc-8fbf-cf479378b413 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:35 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c11924e7-a630-49fc-8fbf-cf479378b413 1073741824 Jun 04 13:35:35 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c4f610-0da8-4b32-ae03-29b1abe7dcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34ec9ff-d6dc-4722-9870-f09cee1007c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:35 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558 (cf2de67d-3bff-4c6d-a8ff-1f5571c51558): created successfully Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34ec9ff-d6dc-4722-9870-f09cee1007c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Flow 'volume_create_manager' (bdd5e40c-c019-4a58-8395-7129787ed5ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:35 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c1a52344-c600-4f3b-94f5-0999d61e8a12 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Created volume successfully. Jun 04 13:35:35 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c11924e7-a630-49fc-8fbf-cf479378b413 1073741824" returned: 0 in 0.750s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c11924e7-a630-49fc-8fbf-cf479378b413 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:35 devstack sudo[104569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c11924e7-a630-49fc-8fbf-cf479378b413 Jun 04 13:35:35 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:36 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c11924e7-a630-49fc-8fbf-cf479378b413" returned: 0 in 0.600s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:35:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899b16dc-ae62-43f7-af14-1181a8821a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c11924e7-a630-49fc-8fbf-cf479378b413', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d44f96-ca69-4064-8b7a-4079afbe3dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:36 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Volume volume-c11924e7-a630-49fc-8fbf-cf479378b413 (c11924e7-a630-49fc-8fbf-cf479378b413): created successfully Jun 04 13:35:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d44f96-ca69-4064-8b7a-4079afbe3dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Flow 'volume_create_manager' (39c0071b-05f8-4ab7-a414-8c3ac4d00a4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:36 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f26ff728-1d3d-4837-b920-f873113de82b tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Created volume successfully. Jun 04 13:35:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "cinder-c11924e7-a630-49fc-8fbf-cf479378b413-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-c11924e7-a630-49fc-8fbf-cf479378b413-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "cinder-quobyte-c11924e7-a630-49fc-8fbf-cf479378b413" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-quobyte-c11924e7-a630-49fc-8fbf-cf479378b413" acquired by "delete_volume" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0912cb1-000e-4083-abae-dbe38df9f6a5]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c11924e7-a630-49fc-8fbf-cf479378b413 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:37 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c11924e7-a630-49fc-8fbf-cf479378b413 Jun 04 13:35:37 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:37 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c11924e7-a630-49fc-8fbf-cf479378b413" returned: 0 in 0.686s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c11924e7-a630-49fc-8fbf-cf479378b413 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:37 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c11924e7-a630-49fc-8fbf-cf479378b413 Jun 04 13:35:37 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:38 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c11924e7-a630-49fc-8fbf-cf479378b413" returned: 0 in 0.578s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:38 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-quobyte-c11924e7-a630-49fc-8fbf-cf479378b413" released by "delete_volume" :: held 1.302s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:38 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Created reservations ['23e9748a-524d-493a-a22b-3bb7f4527315', '987f25a3-134f-43c2-8449-424c7c17abd8', '0f5d09ed-26d8-4740-bdab-1c7077f8c9e6', 'ac40578d-26f4-42af-8c93-cb06096f0c76'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:35:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:38 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:35:38 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:39 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.566s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:39 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:35:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Deleted volume successfully. Jun 04 13:35:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-5ef1115e-e6c2-40c6-9471-a5f152dabf5c tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-c11924e7-a630-49fc-8fbf-cf479378b413-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "cinder-cf2de67d-3bff-4c6d-a8ff-1f5571c51558-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-cf2de67d-3bff-4c6d-a8ff-1f5571c51558-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "cinder-quobyte-cf2de67d-3bff-4c6d-a8ff-1f5571c51558" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-quobyte-cf2de67d-3bff-4c6d-a8ff-1f5571c51558" acquired by "delete_volume" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:39 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e12f00-9ad0-4e6b-b0b1-3719236b430e]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:39 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558 Jun 04 13:35:39 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:40 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558" returned: 0 in 0.690s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:40 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558 Jun 04 13:35:40 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:40 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cf2de67d-3bff-4c6d-a8ff-1f5571c51558" returned: 0 in 0.577s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-quobyte-cf2de67d-3bff-4c6d-a8ff-1f5571c51558" released by "delete_volume" :: held 1.307s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:40 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Created reservations ['3cbe98c0-15f4-4866-bd9d-693bf80480f9', 'a63804ec-9930-46f8-9d1f-3d20c236bdb2', 'adf7487e-f3a3-4ae6-936d-2fb49c60d3c5', '026605ab-70fd-4be1-ac63-dca3309f71c9'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:35:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:40 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:40 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:35:40 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:41 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.573s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:41 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:35:41 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Deleted volume successfully. Jun 04 13:35:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-95079ec8-1fc5-4e4c-bb85-54d9cb2a62a5 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-cf2de67d-3bff-4c6d-a8ff-1f5571c51558-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "cinder-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "cinder-quobyte-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-quobyte-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2" acquired by "delete_volume" :: waited 0.014s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:41 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7fc1a4-aac7-46a1-a50a-878952beda35]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:41 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2 Jun 04 13:35:41 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:42 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2" returned: 0 in 0.701s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:42 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2 Jun 04 13:35:42 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:42 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2" returned: 0 in 0.602s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-quobyte-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2" released by "delete_volume" :: held 1.340s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:42 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Created reservations ['bf19ceed-4a00-44c7-b76c-d930e70902a0', '247211a7-3506-499d-9c12-7e02c6e1420c', 'b30ffbdd-638c-4a10-84be-46a27b6fe75a', 'f1e06c77-9f58-4cdb-a3e6-8254f4e65108'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:43 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:35:43 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:43 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.597s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:35:43 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Deleted volume successfully. Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d3d36a28-3456-408c-bfe0-602b95519ace tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-fb5deaab-e34c-46e5-a488-aacc3a9d1bf2-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "cinder-e00be6a6-14a0-4d62-8c51-b97276ce74a5-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-e00be6a6-14a0-4d62-8c51-b97276ce74a5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "cinder-quobyte-e00be6a6-14a0-4d62-8c51-b97276ce74a5" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-quobyte-e00be6a6-14a0-4d62-8c51-b97276ce74a5" acquired by "delete_volume" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde13072-33d9-4188-b0f6-9f4f5a57384e]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:43 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5 Jun 04 13:35:43 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:44 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5" returned: 0 in 0.693s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:44 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5 Jun 04 13:35:44 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:45 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e00be6a6-14a0-4d62-8c51-b97276ce74a5" returned: 0 in 0.600s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-quobyte-e00be6a6-14a0-4d62-8c51-b97276ce74a5" released by "delete_volume" :: held 1.330s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Created reservations ['32b63697-5618-4dec-a632-b1a9e3c04a18', 'baff1912-22b9-41ca-b091-010e43449134', '917bb4e5-567d-49dd-ba48-0e941011ceb9', '264360e8-7cd9-474c-a33f-44abc7036eba'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:45 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:35:45 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:45 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.604s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:35:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Deleted volume successfully. Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-331cd6be-31d2-4666-b8dd-e97fd28fb550 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-e00be6a6-14a0-4d62-8c51-b97276ce74a5-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "cinder-09a7144d-cba6-4e4f-82d1-939aee289ea9-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-09a7144d-cba6-4e4f-82d1-939aee289ea9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "cinder-quobyte-09a7144d-cba6-4e4f-82d1-939aee289ea9" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-quobyte-09a7144d-cba6-4e4f-82d1-939aee289ea9" acquired by "delete_volume" :: waited 0.014s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eeb575-1f52-4862-998d-369e23c80086]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-09a7144d-cba6-4e4f-82d1-939aee289ea9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:46 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-09a7144d-cba6-4e4f-82d1-939aee289ea9 Jun 04 13:35:46 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:46 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-09a7144d-cba6-4e4f-82d1-939aee289ea9" returned: 0 in 0.697s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-09a7144d-cba6-4e4f-82d1-939aee289ea9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:46 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-09a7144d-cba6-4e4f-82d1-939aee289ea9 Jun 04 13:35:46 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:47 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-09a7144d-cba6-4e4f-82d1-939aee289ea9" returned: 0 in 0.585s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-quobyte-09a7144d-cba6-4e4f-82d1-939aee289ea9" released by "delete_volume" :: held 1.320s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:47 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Created reservations ['f70426fc-bb7f-4888-be77-848a279423bd', 'db4eea28-ecd2-4d21-90a3-3389614f4cac', 'a6187034-f985-4298-9729-87750d5984b7', 'f41100c5-6f62-43c0-9f0b-885723c8a863'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:35:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:47 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:35:47 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:48 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.579s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:48 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:35:48 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Deleted volume successfully. Jun 04 13:35:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-c0dc390f-1685-4a8d-91cb-193742937a52 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-09a7144d-cba6-4e4f-82d1-939aee289ea9-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "cinder-3ac46eb6-1441-49ee-949b-eb64dad56e8e-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-3ac46eb6-1441-49ee-949b-eb64dad56e8e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "cinder-quobyte-3ac46eb6-1441-49ee-949b-eb64dad56e8e" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:35:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-quobyte-3ac46eb6-1441-49ee-949b-eb64dad56e8e" acquired by "delete_volume" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:35:48 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[219ffebf-8ecd-49f4-ada5-1c093b2d0e0a]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:48 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e Jun 04 13:35:48 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:48 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e" returned: 0 in 0.684s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:48 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e Jun 04 13:35:48 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:49 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-3ac46eb6-1441-49ee-949b-eb64dad56e8e" returned: 0 in 0.605s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-quobyte-3ac46eb6-1441-49ee-949b-eb64dad56e8e" released by "delete_volume" :: held 1.325s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:49 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Created reservations ['3cee768c-4b9a-449c-9b37-b93e0aff5734', '5b79098c-4d6e-45e6-8ade-3ce786dc8e1d', 'f56126d3-c2df-4dc1-8d9c-8db6e5e439bc', '07d5824b-e531-436d-b751-6360cf9a4b5b'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:35:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:49 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:35:49 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:50 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.595s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:50 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:35:50 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Deleted volume successfully. Jun 04 13:35:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-dbd49b75-6fcd-4f78-bcd7-acd67a731ad1 tempest-CreateVolumesFromSourceVolumeTest-1311613479 None] Lock "cinder-3ac46eb6-1441-49ee-949b-eb64dad56e8e-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Flow 'volume_create_manager' (0b1c5310-baeb-4b3f-ae34-4b7e873754f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063487e5-036a-4d49-b1cd-e0e39e1f9374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063487e5-036a-4d49-b1cd-e0e39e1f9374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb76d90-8973-4d42-a8c4-577fca17c1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904426664534bb39b237c776ab863e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:53Z,use_quota=True,user_id='dcb46855d3774865bfee12b860631b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424681d1-e97f-4451-bc06-27d7bc042836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (424681d1-e97f-4451-bc06-27d7bc042836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11ac17e-b995-4df6-b8e0-2fd97ba1a446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11ac17e-b995-4df6-b8e0-2fd97ba1a446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceb76d90-8973-4d42-a8c4-577fca17c1d5', 'volume_name': 'volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5061ac-b0e5-4e31-a6c2-960a8d29a44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5061ac-b0e5-4e31-a6c2-960a8d29a44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5b2a9a-31d1-443e-a301-4758a9f6780b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:52 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Volume ceb76d90-8973-4d42-a8c4-577fca17c1d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5', 'volume_size': 1} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceb76d90-8973-4d42-a8c4-577fca17c1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904426664534bb39b237c776ab863e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:53Z,use_quota=True,user_id='dcb46855d3774865bfee12b860631b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Creating volume ceb76d90-8973-4d42-a8c4-577fca17c1d5 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:35:52 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:35:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:52 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5 1073741824 Jun 04 13:35:52 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:53 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5 1073741824" returned: 0 in 0.744s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:53 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5 Jun 04 13:35:53 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:54 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5" returned: 0 in 0.581s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:35:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b5b2a9a-31d1-443e-a301-4758a9f6780b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b362b084-8ca9-4cc9-8f52-155e8461660b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:54 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Volume volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5 (ceb76d90-8973-4d42-a8c4-577fca17c1d5): created successfully Jun 04 13:35:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b362b084-8ca9-4cc9-8f52-155e8461660b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:54 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Flow 'volume_create_manager' (0b1c5310-baeb-4b3f-ae34-4b7e873754f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:54 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b5c38a47-5464-4d1c-8d43-0019f7e96dbe tempest-CinderUnicodeTest-31518584 None] Created volume successfully. Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Flow 'volume_create_manager' (43510916-7a4d-4bd8-b0a0-296e43005b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b2da47-fdef-4273-b3b9-771afd7153d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b2da47-fdef-4273-b3b9-771afd7153d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1146540793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07a5bb6-cb91-4006-83ed-fcae635bfba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904426664534bb39b237c776ab863e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:55Z,use_quota=True,user_id='dcb46855d3774865bfee12b860631b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde96ba0-0d78-4403-a8d1-a32ae49ff965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde96ba0-0d78-4403-a8d1-a32ae49ff965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51928cf-1645-44fc-b0ee-0b4dd502777c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51928cf-1645-44fc-b0ee-0b4dd502777c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c07a5bb6-cb91-4006-83ed-fcae635bfba9', 'volume_name': 'volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3117afa-d7cb-429a-93fa-219eff4a26c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3117afa-d7cb-429a-93fa-219eff4a26c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021b9392-0940-4f7c-b429-e9ae24487ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:55 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Volume c07a5bb6-cb91-4006-83ed-fcae635bfba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9', 'volume_size': 1} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:35:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1146540793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07a5bb6-cb91-4006-83ed-fcae635bfba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904426664534bb39b237c776ab863e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:35:55Z,use_quota=True,user_id='dcb46855d3774865bfee12b860631b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Creating volume c07a5bb6-cb91-4006-83ed-fcae635bfba9 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:35:55 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:35:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:55 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 1073741824 Jun 04 13:35:55 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:56 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 1073741824" returned: 0 in 0.763s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:56 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 Jun 04 13:35:56 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:56 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9" returned: 0 in 0.611s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:56 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:35:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:35:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021b9392-0940-4f7c-b429-e9ae24487ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da59603-551b-4c62-8686-cb71f55f6c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:35:56 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Volume volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 (c07a5bb6-cb91-4006-83ed-fcae635bfba9): created successfully Jun 04 13:35:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da59603-551b-4c62-8686-cb71f55f6c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:35:56 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Flow 'volume_create_manager' (43510916-7a4d-4bd8-b0a0-296e43005b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:35:56 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-740b4e0e-ef7d-40fa-8ce5-d1416e012e5c tempest-CinderUnicodeTest-31518584 None] Created volume successfully. Jun 04 13:35:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:35:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:35:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] Creating offline snapshot f099a31e-e880-49cf-be9e-9a407e24554e of volume c07a5bb6-cb91-4006-83ed-fcae635bfba9 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:35:57 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c195f4-48f9-408e-9f14-d793342da220]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:35:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:57 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 Jun 04 13:35:57 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:58 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9" returned: 0 in 0.712s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:58 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e 1G Jun 04 13:35:58 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:59 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e 1G" returned: 0 in 0.722s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:59 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e Jun 04 13:35:59 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:35:59 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Jun 04 13:35:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e" returned: 0 in 0.638s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:35:59 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e is being set with open permissions: ugo+rw Jun 04 13:35:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:35:59 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e Jun 04 13:35:59 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:00 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e" returned: 0 in 0.579s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:00 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.info Jun 04 13:36:00 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:00 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.info" returned: 0 in 0.588s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:00 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.info is being set with open permissions: ugo+rw Jun 04 13:36:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:01 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.info Jun 04 13:36:01 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:01 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.info" returned: 0 in 0.574s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.896s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:01 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8833ea71-a686-4637-bef0-37610cf9501b tempest-CinderUnicodeTest-31518584 None] Create snapshot completed successfully Jun 04 13:36:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Acquiring lock "cinder-f099a31e-e880-49cf-be9e-9a407e24554e-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Lock "cinder-f099a31e-e880-49cf-be9e-9a407e24554e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Acquiring lock "cinder-quobyte-c07a5bb6-cb91-4006-83ed-fcae635bfba9" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Lock "cinder-quobyte-c07a5bb6-cb91-4006-83ed-fcae635bfba9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Acquiring lock "cinder-quobyte-f099a31e-e880-49cf-be9e-9a407e24554e" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:01 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Lock "cinder-quobyte-f099a31e-e880-49cf-be9e-9a407e24554e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Deleting offline snapshot f099a31e-e880-49cf-be9e-9a407e24554e of volume c07a5bb6-cb91-4006-83ed-fcae635bfba9 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:36:01 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] snapshot_file for this snap is: volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:36:01 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[097874d3-c976-45df-a7cf-54d1759b7bba]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:02 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e Jun 04 13:36:02 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:02 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e" returned: 0 in 0.718s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:36:02 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b681a2ed-9e83-4e0a-b351-e6e438bfd0a8]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:02 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 Jun 04 13:36:02 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:03 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9" returned: 0 in 0.693s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:03 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e Jun 04 13:36:03 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:04 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e" returned: 0 in 0.663s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:04 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:04 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:04 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e Jun 04 13:36:04 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:04 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9.f099a31e-e880-49cf-be9e-9a407e24554e" returned: 0 in 0.582s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:04 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.605s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Lock "cinder-quobyte-f099a31e-e880-49cf-be9e-9a407e24554e" released by "_delete_snapshot" :: held 2.763s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Lock "cinder-quobyte-c07a5bb6-cb91-4006-83ed-fcae635bfba9" released by "delete_snapshot" :: held 2.785s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Created reservations ['ff8d0733-e732-4a7b-8ef9-ae8ed2268ced', '4e755030-4a1b-4d42-93dd-83bb4f140bdd', 'a2022645-1b08-4c3e-859f-418772589c04', 'b1b50e1d-ad12-40bb-a6cc-cada25a19a15'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:04 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Delete snapshot completed successfully. Jun 04 13:36:04 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-cffa29a8-dc2d-40d2-8f33-1dfaea800441 tempest-CinderUnicodeTest-31518584 None] Lock "cinder-f099a31e-e880-49cf-be9e-9a407e24554e-delete_snapshot" released by "delete_snapshot" :: held 2.906s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:05 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Acquiring lock "cinder-c07a5bb6-cb91-4006-83ed-fcae635bfba9-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:05 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Lock "cinder-c07a5bb6-cb91-4006-83ed-fcae635bfba9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:05 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Acquiring lock "cinder-quobyte-c07a5bb6-cb91-4006-83ed-fcae635bfba9" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:05 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Lock "cinder-quobyte-c07a5bb6-cb91-4006-83ed-fcae635bfba9" acquired by "delete_volume" :: waited 0.014s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:05 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90f463c-6177-46da-a066-43fd7f8d5491]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:05 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 Jun 04 13:36:05 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:06 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9" returned: 0 in 0.696s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:06 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9 Jun 04 13:36:06 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:06 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c07a5bb6-cb91-4006-83ed-fcae635bfba9" returned: 0 in 0.588s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:06 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Lock "cinder-quobyte-c07a5bb6-cb91-4006-83ed-fcae635bfba9" released by "delete_volume" :: held 1.338s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:06 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Created reservations ['474395f9-acec-4645-b25c-af6ddc010b26', '497fc741-3337-47ac-a799-1ae794598dba', 'd8491c12-50d5-4289-9dba-5f22489f1b09', 'b5635f4c-6fb4-4c8e-bc9d-d2c67ccf39e3'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:06 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:06 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:07 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.588s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:07 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:07 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Deleted volume successfully. Jun 04 13:36:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-13315e96-fcc5-4f3d-abc0-ef4e91a4b94d tempest-CinderUnicodeTest-31518584 None] Lock "cinder-c07a5bb6-cb91-4006-83ed-fcae635bfba9-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Acquiring lock "cinder-ceb76d90-8973-4d42-a8c4-577fca17c1d5-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Lock "cinder-ceb76d90-8973-4d42-a8c4-577fca17c1d5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Acquiring lock "cinder-quobyte-ceb76d90-8973-4d42-a8c4-577fca17c1d5" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:07 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Lock "cinder-quobyte-ceb76d90-8973-4d42-a8c4-577fca17c1d5" acquired by "delete_volume" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:07 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca542510-71aa-463f-aff1-9aeeb72b0d3d]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:07 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5 Jun 04 13:36:07 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:08 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5" returned: 0 in 0.707s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:08 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5 Jun 04 13:36:08 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:08 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ceb76d90-8973-4d42-a8c4-577fca17c1d5" returned: 0 in 0.590s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:08 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Lock "cinder-quobyte-ceb76d90-8973-4d42-a8c4-577fca17c1d5" released by "delete_volume" :: held 1.336s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:08 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Created reservations ['9da8b87c-c409-400d-b37b-64d80ccfd2f2', '2d54fd12-681d-4f4d-8f55-0672a344ad7a', '7669691f-eeb6-4c3e-add6-cd5bf8cb3d1e', '11ff8de8-ef1b-44eb-abc3-f0f786326dd3'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:09 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:09 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:09 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:09 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.592s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:09 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:09 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Deleted volume successfully. Jun 04 13:36:09 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-01edc320-2b96-43a0-8a82-873ac67b74a5 tempest-CinderUnicodeTest-31518584 None] Lock "cinder-ceb76d90-8973-4d42-a8c4-577fca17c1d5-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:19 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=136,cinder:DELETE=13,cinder:SELECT=91,cinder:INSERT=36 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:36:19 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=139,cinder:SELECT=101,cinder:INSERT=38,cinder:DELETE=10 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Flow 'volume_create_manager' (3a11be3d-bf7b-4c6e-9566-4d81905bc19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbefbd19-9cfd-42e8-b41a-37449a3a43a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbefbd19-9cfd-42e8-b41a-37449a3a43a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-422564710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d413bbf2-70d1-490a-8dae-e1bfc5bef549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e904fe11c4bf2893bc182ae412bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:21Z,use_quota=True,user_id='279fe4f34cc44d669aeb7c52bd5ec19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45c3249-7d70-4aab-83f1-f8da64a6e60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e45c3249-7d70-4aab-83f1-f8da64a6e60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7505baa3-0932-4aa7-a3d6-ed5661bf0854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7505baa3-0932-4aa7-a3d6-ed5661bf0854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd413bbf2-70d1-490a-8dae-e1bfc5bef549', 'volume_name': 'volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d54f40-3e71-4b91-96af-5ff51369777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d54f40-3e71-4b91-96af-5ff51369777f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdda1dcc-e691-470b-b2c9-30ac5a4ce021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:21 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume d413bbf2-70d1-490a-8dae-e1bfc5bef549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549', 'volume_size': 1} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-422564710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d413bbf2-70d1-490a-8dae-e1bfc5bef549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e904fe11c4bf2893bc182ae412bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:21Z,use_quota=True,user_id='279fe4f34cc44d669aeb7c52bd5ec19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Creating volume d413bbf2-70d1-490a-8dae-e1bfc5bef549 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:21 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:21 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549 1073741824 Jun 04 13:36:21 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Flow 'volume_create_manager' (18da570b-df3f-45a9-bb66-44a025587353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5cad76-ffd9-4573-accc-24d603bb19e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5cad76-ffd9-4573-accc-24d603bb19e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-915040642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a1741d-6650-4fb7-ae53-2cc9a218ba4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba894d9fa154a5ea467159e710293eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:21Z,use_quota=True,user_id='f51a2b8204524b0ca59a9bc20f46ad20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb56b11-3900-4f25-9063-ecefc5ff3f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb56b11-3900-4f25-9063-ecefc5ff3f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb37a69-f482-4b48-9cd6-62789b56caa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb37a69-f482-4b48-9cd6-62789b56caa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a1741d-6650-4fb7-ae53-2cc9a218ba4d', 'volume_name': 'volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43fcf81-a48b-43d0-a7c3-ee271f459331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43fcf81-a48b-43d0-a7c3-ee271f459331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be05e118-2fb2-410b-9ec7-a3a0d23d6ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:21 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Volume a6a1741d-6650-4fb7-ae53-2cc9a218ba4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d', 'volume_size': 1} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:21 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Flow 'volume_create_manager' (26be21f6-cbb7-4b74-8101-40f7f817cf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce61d51-bc29-4bd7-a7e7-026332ea1338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce61d51-bc29-4bd7-a7e7-026332ea1338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-289484754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc474f90-1289-4733-b78f-c0c47b25732a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba894d9fa154a5ea467159e710293eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:22Z,use_quota=True,user_id='f51a2b8204524b0ca59a9bc20f46ad20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348caf67-f816-412c-8154-dde467a13afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348caf67-f816-412c-8154-dde467a13afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8038852-06eb-4d2e-8454-22702c2f3b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8038852-06eb-4d2e-8454-22702c2f3b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc474f90-1289-4733-b78f-c0c47b25732a', 'volume_name': 'volume-cc474f90-1289-4733-b78f-c0c47b25732a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fbfd17-28b5-43de-babc-a42f481aa7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fbfd17-28b5-43de-babc-a42f481aa7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554f0e40-cb5e-4bd7-8d51-033b80b5db70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Volume cc474f90-1289-4733-b78f-c0c47b25732a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc474f90-1289-4733-b78f-c0c47b25732a', 'volume_size': 1} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Flow 'volume_create_manager' (0d167805-2b66-4cb0-8f8d-3297fcd5bc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd61f77b-efbb-4b0e-949d-dd50b0b17c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd61f77b-efbb-4b0e-949d-dd50b0b17c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e0a0c9-6d06-4933-a41c-f722b95d26e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161dd02fb82f4ccc83b4cf944020fd6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:22Z,use_quota=True,user_id='43700ed321a3413aaa38436347b1bd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cef4852-2cb7-44ba-9b48-e7078fc1825a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cef4852-2cb7-44ba-9b48-e7078fc1825a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abedef64-545d-4c75-af76-a0fa66065e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abedef64-545d-4c75-af76-a0fa66065e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e0a0c9-6d06-4933-a41c-f722b95d26e5', 'volume_name': 'volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8361a45-22ac-4b73-a5dd-779fddb14b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8361a45-22ac-4b73-a5dd-779fddb14b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a814a07-c78a-4ead-98fa-da7a7db2e4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Volume a1e0a0c9-6d06-4933-a41c-f722b95d26e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5', 'volume_size': 1} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:22 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549 1073741824" returned: 0 in 1.086s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:22 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549 Jun 04 13:36:22 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Flow 'volume_create_manager' (43b04afd-8c9d-4660-8665-4a5f27d45055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f442b88-7d10-45e4-9a31-fa1b7b6d86c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f442b88-7d10-45e4-9a31-fa1b7b6d86c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782191226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f9914b-359d-41f7-a2d4-6fc8105d4648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba894d9fa154a5ea467159e710293eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:23Z,use_quota=True,user_id='f51a2b8204524b0ca59a9bc20f46ad20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7814d908-f424-4de9-a8a1-2f4456803239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7814d908-f424-4de9-a8a1-2f4456803239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea0ccce-fe42-4cef-b1c0-2c3518cc603c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ea0ccce-fe42-4cef-b1c0-2c3518cc603c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05f9914b-359d-41f7-a2d4-6fc8105d4648', 'volume_name': 'volume-05f9914b-359d-41f7-a2d4-6fc8105d4648', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446669ee-eda3-4b08-941e-ba79074a1db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446669ee-eda3-4b08-941e-ba79074a1db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc37d47-6fc8-4457-8b69-5224493ba655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:22 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Volume 05f9914b-359d-41f7-a2d4-6fc8105d4648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05f9914b-359d-41f7-a2d4-6fc8105d4648', 'volume_size': 1} Jun 04 13:36:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Flow 'volume_create_manager' (f76f0839-5b55-4e3a-95ae-9a9336928dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd858e98-419a-42fa-93f2-e1ee6fa5b2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd858e98-419a-42fa-93f2-e1ee6fa5b2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-618644759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09bdb8e-c486-42b6-8187-b971570b3278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba894d9fa154a5ea467159e710293eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:23Z,use_quota=True,user_id='f51a2b8204524b0ca59a9bc20f46ad20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422bfb65-77f2-4000-a025-e8ce5e26827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422bfb65-77f2-4000-a025-e8ce5e26827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be53968c-a15f-4eac-b968-182a71e96d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be53968c-a15f-4eac-b968-182a71e96d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e09bdb8e-c486-42b6-8187-b971570b3278', 'volume_name': 'volume-e09bdb8e-c486-42b6-8187-b971570b3278', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6446e7-643e-41c7-a433-9a7ebaf4e990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6446e7-643e-41c7-a433-9a7ebaf4e990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc33c20-dfd5-4775-96b7-37e49e0834f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:23 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Volume e09bdb8e-c486-42b6-8187-b971570b3278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e09bdb8e-c486-42b6-8187-b971570b3278', 'volume_size': 1} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:23 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549" returned: 0 in 0.677s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.671s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-915040642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a1741d-6650-4fb7-ae53-2cc9a218ba4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba894d9fa154a5ea467159e710293eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:21Z,use_quota=True,user_id='f51a2b8204524b0ca59a9bc20f46ad20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Creating volume a6a1741d-6650-4fb7-ae53-2cc9a218ba4d {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:23 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdda1dcc-e691-470b-b2c9-30ac5a4ce021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:23 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d 1073741824 Jun 04 13:36:23 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d0a1f9-b7db-416e-aea7-694c5e379a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:23 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549 (d413bbf2-70d1-490a-8dae-e1bfc5bef549): created successfully Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d0a1f9-b7db-416e-aea7-694c5e379a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Flow 'volume_create_manager' (3a11be3d-bf7b-4c6e-9566-4d81905bc19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:23 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-1dfe1358-5b71-4685-9c7f-59161404c962 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Created volume successfully. Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Flow 'volume_create_manager' (726c124d-0ed8-4d0f-9cdd-4fd1ea33f6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8ca44d-e665-4efe-9a30-56d362c6fb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8ca44d-e665-4efe-9a30-56d362c6fb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1224231529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b57d2a5-9ceb-4779-9857-3abd22e905c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba894d9fa154a5ea467159e710293eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:23Z,use_quota=True,user_id='f51a2b8204524b0ca59a9bc20f46ad20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3318f98-b93e-40d6-9186-550031bb02f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3318f98-b93e-40d6-9186-550031bb02f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e021e2d2-adab-4d42-b577-ec516950d507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e021e2d2-adab-4d42-b577-ec516950d507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b57d2a5-9ceb-4779-9857-3abd22e905c8', 'volume_name': 'volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043e730b-0517-4905-8fe3-70a48f6170b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043e730b-0517-4905-8fe3-70a48f6170b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509a1cec-5ac3-45c6-9f86-acef977cafde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:23 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Volume 0b57d2a5-9ceb-4779-9857-3abd22e905c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8', 'volume_size': 1} Jun 04 13:36:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Flow 'volume_create_manager' (6c35a3d9-5559-49c0-abdf-a6621777ce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c96671-b22e-41b2-b567-9892a735d181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c96671-b22e-41b2-b567-9892a735d181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-3270204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd009f9-99d3-46f1-8fc7-55ff6db736bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e904fe11c4bf2893bc182ae412bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:24Z,use_quota=True,user_id='279fe4f34cc44d669aeb7c52bd5ec19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f62625-fecc-4769-9bb9-2787a72355a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f62625-fecc-4769-9bb9-2787a72355a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08cb303f-e7c7-433c-b985-f92c452645b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08cb303f-e7c7-433c-b985-f92c452645b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd009f9-99d3-46f1-8fc7-55ff6db736bc', 'volume_name': 'volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (651eb4ce-f98e-421b-a766-65e0d8eecff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (651eb4ce-f98e-421b-a766-65e0d8eecff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6869aa-f1ae-4089-88cf-6b9f683861e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume dcd009f9-99d3-46f1-8fc7-55ff6db736bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc', 'volume_size': 1} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:24 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d 1073741824" returned: 0 in 0.937s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:24 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d Jun 04 13:36:24 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Flow 'volume_create_manager' (fe892ffc-9bad-437a-9a23-d0607099a0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39096bd7-98e7-47ef-a127-4b310498645b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39096bd7-98e7-47ef-a127-4b310498645b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1670521551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21cd5b61-28db-4fc6-945f-cf8f28b62347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e904fe11c4bf2893bc182ae412bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:24Z,use_quota=True,user_id='279fe4f34cc44d669aeb7c52bd5ec19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87b1274-bffb-469d-b99e-7750149815ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87b1274-bffb-469d-b99e-7750149815ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011265b3-5d49-4be3-82b6-005ea6eabf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011265b3-5d49-4be3-82b6-005ea6eabf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21cd5b61-28db-4fc6-945f-cf8f28b62347', 'volume_name': 'volume-21cd5b61-28db-4fc6-945f-cf8f28b62347', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d22056e-7b52-4801-a1be-7d20dacf6006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d22056e-7b52-4801-a1be-7d20dacf6006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86910c9a-79ee-4d7a-b82d-2eab3844dbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume 21cd5b61-28db-4fc6-945f-cf8f28b62347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21cd5b61-28db-4fc6-945f-cf8f28b62347', 'volume_size': 1} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Flow 'volume_create_manager' (91df3abf-4379-4144-a61d-17391b55c7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14be0a8b-3aa6-4ec4-aa24-0c05bc50afd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14be0a8b-3aa6-4ec4-aa24-0c05bc50afd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-941189333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45674494-45d2-4c87-8dce-26a925f4ef63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e904fe11c4bf2893bc182ae412bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:25Z,use_quota=True,user_id='279fe4f34cc44d669aeb7c52bd5ec19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b2d5a6-26d0-4611-964d-740e63dfbb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b2d5a6-26d0-4611-964d-740e63dfbb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de65516-4176-4e64-9486-a923276da0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7de65516-4176-4e64-9486-a923276da0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45674494-45d2-4c87-8dce-26a925f4ef63', 'volume_name': 'volume-45674494-45d2-4c87-8dce-26a925f4ef63', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca383e8-ae05-4875-99e5-bf9b962bb400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca383e8-ae05-4875-99e5-bf9b962bb400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75af60c5-ea73-424a-8ab9-9601bc65e919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:24 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume 45674494-45d2-4c87-8dce-26a925f4ef63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45674494-45d2-4c87-8dce-26a925f4ef63', 'volume_size': 1} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:24 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d" returned: 0 in 0.694s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:24 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.882s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-289484754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc474f90-1289-4733-b78f-c0c47b25732a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba894d9fa154a5ea467159e710293eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:22Z,use_quota=True,user_id='f51a2b8204524b0ca59a9bc20f46ad20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Creating volume cc474f90-1289-4733-b78f-c0c47b25732a {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:25 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cc474f90-1289-4733-b78f-c0c47b25732a 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:25 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cc474f90-1289-4733-b78f-c0c47b25732a 1073741824 Jun 04 13:36:25 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be05e118-2fb2-410b-9ec7-a3a0d23d6ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e6ea35-bc0d-4c6f-b692-f35d716864a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:25 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Volume volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d (a6a1741d-6650-4fb7-ae53-2cc9a218ba4d): created successfully Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93e6ea35-bc0d-4c6f-b692-f35d716864a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Flow 'volume_create_manager' (18da570b-df3f-45a9-bb66-44a025587353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:25 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-e79c6dde-4375-42bb-962c-9433175af01c tempest-CreateVolumesFromImageTest-2086404461 None] Created volume successfully. Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Flow 'volume_create_manager' (a50cfca9-74af-4570-ba7d-499d43696661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b1f1a3-dc77-4a71-b310-c3f3c38be0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b1f1a3-dc77-4a71-b310-c3f3c38be0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1820526898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c916b93-8392-463e-9a4d-ff362914b39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e904fe11c4bf2893bc182ae412bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:25Z,use_quota=True,user_id='279fe4f34cc44d669aeb7c52bd5ec19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72598616-37fd-4a91-ac47-3fb9016fb92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72598616-37fd-4a91-ac47-3fb9016fb92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a312e6-990a-4d50-83e1-aa541ba26a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a312e6-990a-4d50-83e1-aa541ba26a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c916b93-8392-463e-9a4d-ff362914b39a', 'volume_name': 'volume-0c916b93-8392-463e-9a4d-ff362914b39a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e6c97a-1785-4780-a9ec-ae9c654358e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e6c97a-1785-4780-a9ec-ae9c654358e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecd3e8c-271d-42e0-9539-27d11c755524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:25 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume 0c916b93-8392-463e-9a4d-ff362914b39a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c916b93-8392-463e-9a4d-ff362914b39a', 'volume_size': 1} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Flow 'volume_create_manager' (c38bff03-c54b-4a15-8359-04c440d9c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fbd148-a236-4f72-a3fb-51e78e77b399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1fbd148-a236-4f72-a3fb-51e78e77b399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-132711244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd705287-9307-496d-9a51-8ba290adcc10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e904fe11c4bf2893bc182ae412bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:26Z,use_quota=True,user_id='279fe4f34cc44d669aeb7c52bd5ec19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f97c740-dc1c-4b1e-8a8c-746311bf4abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f97c740-dc1c-4b1e-8a8c-746311bf4abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d906402d-434d-463b-901d-69c9e33a1705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d906402d-434d-463b-901d-69c9e33a1705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd705287-9307-496d-9a51-8ba290adcc10', 'volume_name': 'volume-cd705287-9307-496d-9a51-8ba290adcc10', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e4b79e-8a96-43f1-85ea-4675c1dea962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e4b79e-8a96-43f1-85ea-4675c1dea962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76fa47a-23a0-4ad5-ad06-b3124d861da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:25 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume cd705287-9307-496d-9a51-8ba290adcc10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd705287-9307-496d-9a51-8ba290adcc10', 'volume_size': 1} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Flow 'volume_create_manager' (6e874bee-f303-4789-89ae-4359b06701b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe441652-1445-4a3b-bae6-dcffae84b065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe441652-1445-4a3b-bae6-dcffae84b065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b097e3-6719-49ef-8eca-fcd2ecda8ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bd5d169f544082acc1c4230e781058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:26Z,use_quota=True,user_id='9e70a5862cd344ec9b9d95c3cc4a3b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82fdae47-4a68-4534-a23f-f1c96ffd85b4),volume_type_id=82fdae47-4a68-4534-a23f-f1c96ffd85b4)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee0334e-8325-43c6-9503-b117630af036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee0334e-8325-43c6-9503-b117630af036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebaf76f1-175a-4348-88b0-54cda352382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.image.glance [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Creating Keystone auth plugin from conf {{(pid=86722) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 13:36:26 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cc474f90-1289-4733-b78f-c0c47b25732a 1073741824" returned: 0 in 1.004s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cc474f90-1289-4733-b78f-c0c47b25732a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:26 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cc474f90-1289-4733-b78f-c0c47b25732a Jun 04 13:36:26 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebaf76f1-175a-4348-88b0-54cda352382b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c6b097e3-6719-49ef-8eca-fcd2ecda8ad2', 'volume_name': 'volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2', 'volume_size': 1, 'image_id': '65490922-ac96-481a-951c-15b5bbc4a51c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65490922-ac96-481a-951c-15b5bbc4a51c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '83f2ef53d795e7ad638c5731e46e4def', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2bd5d169f544082acc1c4230e781058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0480f7732315dcf27c69c2e1eb160cc05d735b9e156ed25054577c27681af4bbfed0751c0178fc519ab9a74df5375bdf1b2c12a49d95f988cbe6d9b6afdf4bff', 'id': '65490922-ac96-481a-951c-15b5bbc4a51c', 'created_at': datetime.datetime(2026, 6, 4, 11, 36, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 36, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65490922-ac96-481a-951c-15b5bbc4a51c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27642809-45bb-49f3-9b6c-bbc74087b6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27642809-45bb-49f3-9b6c-bbc74087b6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37ba70b-c4de-458c-aaa3-fdd499e40539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:26 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Volume c6b097e3-6719-49ef-8eca-fcd2ecda8ad2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2', 'volume_size': 1, 'image_id': '65490922-ac96-481a-951c-15b5bbc4a51c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65490922-ac96-481a-951c-15b5bbc4a51c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '83f2ef53d795e7ad638c5731e46e4def', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2bd5d169f544082acc1c4230e781058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0480f7732315dcf27c69c2e1eb160cc05d735b9e156ed25054577c27681af4bbfed0751c0178fc519ab9a74df5375bdf1b2c12a49d95f988cbe6d9b6afdf4bff', 'id': '65490922-ac96-481a-951c-15b5bbc4a51c', 'created_at': datetime.datetime(2026, 6, 4, 11, 36, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 36, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65490922-ac96-481a-951c-15b5bbc4a51c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Trying to clone c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 from image 65490922-ac96-481a-951c-15b5bbc4a51c at location (None, [{'url': 'file:///opt/stack/data/glance/images/65490922-ac96-481a-951c-15b5bbc4a51c', 'metadata': {}}]). {{(pid=86722) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 13:36:26 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Image download 0.00 MB at 0.00 MB/s Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f19bb30-3915-406f-9314-b970c4d29a8c]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:26 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD Jun 04 13:36:26 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:26 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cc474f90-1289-4733-b78f-c0c47b25732a" returned: 0 in 0.636s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.390s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e0a0c9-6d06-4933-a41c-f722b95d26e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161dd02fb82f4ccc83b4cf944020fd6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:22Z,use_quota=True,user_id='43700ed321a3413aaa38436347b1bd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Creating volume a1e0a0c9-6d06-4933-a41c-f722b95d26e5 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:26 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (554f0e40-cb5e-4bd7-8d51-033b80b5db70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc474f90-1289-4733-b78f-c0c47b25732a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:26 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5 1073741824 Jun 04 13:36:26 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc690fc-ad77-4440-882a-c8fefe66bbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:26 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Volume volume-cc474f90-1289-4733-b78f-c0c47b25732a (cc474f90-1289-4733-b78f-c0c47b25732a): created successfully Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc690fc-ad77-4440-882a-c8fefe66bbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:26 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Flow 'volume_create_manager' (26be21f6-cbb7-4b74-8101-40f7f817cf1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:26 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-0f287c9b-bbe7-4638-b01f-ad598309da5c tempest-CreateVolumesFromImageTest-2086404461 None] Created volume successfully. Jun 04 13:36:27 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD" returned: 0 in 0.713s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:27 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD Jun 04 13:36:27 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:27 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5 1073741824" returned: 0 in 0.755s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:27 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5 Jun 04 13:36:27 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:27 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD" returned: 1 in 0.720s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:36:27 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Temporary image 65490922-ac96-481a-951c-15b5bbc4a51c is fetched for user 9e70a5862cd344ec9b9d95c3cc4a3b79. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 13:36:27 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95e172a-4fd4-4ddb-91ec-6fe3e703369a]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:27 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD Jun 04 13:36:27 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:28 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5" returned: 0 in 0.599s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.323s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782191226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05f9914b-359d-41f7-a2d4-6fc8105d4648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba894d9fa154a5ea467159e710293eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:23Z,use_quota=True,user_id='f51a2b8204524b0ca59a9bc20f46ad20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Creating volume 05f9914b-359d-41f7-a2d4-6fc8105d4648 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:28 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-05f9914b-359d-41f7-a2d4-6fc8105d4648 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:28 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-05f9914b-359d-41f7-a2d4-6fc8105d4648 1073741824 Jun 04 13:36:28 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a814a07-c78a-4ead-98fa-da7a7db2e4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13ef865-a749-4848-9628-d92549638675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:28 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Volume volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5 (a1e0a0c9-6d06-4933-a41c-f722b95d26e5): created successfully Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13ef865-a749-4848-9628-d92549638675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Flow 'volume_create_manager' (0d167805-2b66-4cb0-8f8d-3297fcd5bc61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:28 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8db4ba5b-bb0e-46a1-8b01-fe4e0fd3b1c8 tempest-CinderUnicodeTest-1707824945 None] Created volume successfully. Jun 04 13:36:28 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD" returned: 0 in 0.694s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:28 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD Jun 04 13:36:28 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:28 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-05f9914b-359d-41f7-a2d4-6fc8105d4648 1073741824" returned: 0 in 0.827s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-05f9914b-359d-41f7-a2d4-6fc8105d4648 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:29 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-05f9914b-359d-41f7-a2d4-6fc8105d4648 Jun 04 13:36:29 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:29 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD" returned: 1 in 0.702s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Flow 'volume_create_manager' (5615042e-fcf1-4685-a99b-f2862628696a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1aaa77-3b46-4acc-9c26-6f7ee9e15de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1aaa77-3b46-4acc-9c26-6f7ee9e15de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1828952910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca865481-5dc0-4560-a1dd-c2a6792cd457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161dd02fb82f4ccc83b4cf944020fd6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:29Z,use_quota=True,user_id='43700ed321a3413aaa38436347b1bd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30bf3e3b-dc8d-4794-8567-945ef763422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30bf3e3b-dc8d-4794-8567-945ef763422e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c8499c-a46f-4b9f-ac93-eedc4af32921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c8499c-a46f-4b9f-ac93-eedc4af32921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca865481-5dc0-4560-a1dd-c2a6792cd457', 'volume_name': 'volume-ca865481-5dc0-4560-a1dd-c2a6792cd457', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad2edfd-876f-40f4-9c5d-222cbab30020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad2edfd-876f-40f4-9c5d-222cbab30020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589c449b-c0e2-4f0a-b38c-33330c055fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:29 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Volume ca865481-5dc0-4560-a1dd-c2a6792cd457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca865481-5dc0-4560-a1dd-c2a6792cd457', 'volume_size': 1} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:29 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-05f9914b-359d-41f7-a2d4-6fc8105d4648" returned: 0 in 0.633s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.464s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-618644759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09bdb8e-c486-42b6-8187-b971570b3278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba894d9fa154a5ea467159e710293eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:23Z,use_quota=True,user_id='f51a2b8204524b0ca59a9bc20f46ad20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Creating volume e09bdb8e-c486-42b6-8187-b971570b3278 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:29 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e09bdb8e-c486-42b6-8187-b971570b3278 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:29 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e09bdb8e-c486-42b6-8187-b971570b3278 1073741824 Jun 04 13:36:29 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc37d47-6fc8-4457-8b69-5224493ba655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05f9914b-359d-41f7-a2d4-6fc8105d4648', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007eff85-55f8-4054-87cc-0c50c5802d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:29 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Volume volume-05f9914b-359d-41f7-a2d4-6fc8105d4648 (05f9914b-359d-41f7-a2d4-6fc8105d4648): created successfully Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007eff85-55f8-4054-87cc-0c50c5802d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Flow 'volume_create_manager' (43b04afd-8c9d-4660-8665-4a5f27d45055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:29 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-508a8cfa-b392-43d8-ac01-60aa3b36bc5b tempest-CreateVolumesFromImageTest-2086404461 None] Created volume successfully. Jun 04 13:36:30 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e09bdb8e-c486-42b6-8187-b971570b3278 1073741824" returned: 0 in 0.753s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e09bdb8e-c486-42b6-8187-b971570b3278 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:30 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e09bdb8e-c486-42b6-8187-b971570b3278 Jun 04 13:36:30 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:31 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e09bdb8e-c486-42b6-8187-b971570b3278" returned: 0 in 0.589s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.466s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1224231529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b57d2a5-9ceb-4779-9857-3abd22e905c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ba894d9fa154a5ea467159e710293eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:23Z,use_quota=True,user_id='f51a2b8204524b0ca59a9bc20f46ad20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Creating volume 0b57d2a5-9ceb-4779-9857-3abd22e905c8 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:31 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:31 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8 1073741824 Jun 04 13:36:31 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abc33c20-dfd5-4775-96b7-37e49e0834f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09bdb8e-c486-42b6-8187-b971570b3278', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571abe4f-e291-432a-a4f6-254d0aa3c66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:31 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Volume volume-e09bdb8e-c486-42b6-8187-b971570b3278 (e09bdb8e-c486-42b6-8187-b971570b3278): created successfully Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571abe4f-e291-432a-a4f6-254d0aa3c66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Flow 'volume_create_manager' (f76f0839-5b55-4e3a-95ae-9a9336928dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:31 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6ada7793-f8bf-44e4-92dd-ad6052656cfb tempest-CreateVolumesFromImageTest-2086404461 None] Created volume successfully. Jun 04 13:36:31 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8 1073741824" returned: 0 in 0.753s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:31 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8 Jun 04 13:36:31 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:32 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8" returned: 0 in 0.609s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.266s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-3270204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd009f9-99d3-46f1-8fc7-55ff6db736bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e904fe11c4bf2893bc182ae412bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:24Z,use_quota=True,user_id='279fe4f34cc44d669aeb7c52bd5ec19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Creating volume dcd009f9-99d3-46f1-8fc7-55ff6db736bc {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:32 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509a1cec-5ac3-45c6-9f86-acef977cafde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:32 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc 1073741824 Jun 04 13:36:32 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e7d40e-ffd0-4614-9b98-62fa46ee9697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:32 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Volume volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8 (0b57d2a5-9ceb-4779-9857-3abd22e905c8): created successfully Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8e7d40e-ffd0-4614-9b98-62fa46ee9697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:32 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Flow 'volume_create_manager' (726c124d-0ed8-4d0f-9cdd-4fd1ea33f6ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:32 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-630d4ae4-be9a-4d11-a62a-025dee5ac9d4 tempest-CreateVolumesFromImageTest-2086404461 None] Created volume successfully. Jun 04 13:36:33 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc 1073741824" returned: 0 in 0.775s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:33 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc Jun 04 13:36:33 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "cinder-0b57d2a5-9ceb-4779-9857-3abd22e905c8-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-0b57d2a5-9ceb-4779-9857-3abd22e905c8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "cinder-quobyte-0b57d2a5-9ceb-4779-9857-3abd22e905c8" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-quobyte-0b57d2a5-9ceb-4779-9857-3abd22e905c8" acquired by "delete_volume" :: waited 0.013s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cd3fab-256c-44f7-ba89-07b66ba4203f]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:33 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8 Jun 04 13:36:33 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:33 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc" returned: 0 in 0.622s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.204s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1670521551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21cd5b61-28db-4fc6-945f-cf8f28b62347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e904fe11c4bf2893bc182ae412bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:24Z,use_quota=True,user_id='279fe4f34cc44d669aeb7c52bd5ec19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Creating volume 21cd5b61-28db-4fc6-945f-cf8f28b62347 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:33 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-21cd5b61-28db-4fc6-945f-cf8f28b62347 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:33 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-21cd5b61-28db-4fc6-945f-cf8f28b62347 1073741824 Jun 04 13:36:33 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c6869aa-f1ae-4089-88cf-6b9f683861e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc43d16e-8846-497d-a265-ad669f286991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:33 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc (dcd009f9-99d3-46f1-8fc7-55ff6db736bc): created successfully Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc43d16e-8846-497d-a265-ad669f286991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:33 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Flow 'volume_create_manager' (6c35a3d9-5559-49c0-abdf-a6621777ce14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:33 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-75d5178e-6720-4c21-ac4f-bb1f68e33a9c tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Created volume successfully. Jun 04 13:36:34 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8" returned: 0 in 0.749s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:34 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8 Jun 04 13:36:34 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:34 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-21cd5b61-28db-4fc6-945f-cf8f28b62347 1073741824" returned: 0 in 0.826s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-21cd5b61-28db-4fc6-945f-cf8f28b62347 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:34 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-21cd5b61-28db-4fc6-945f-cf8f28b62347 Jun 04 13:36:34 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:34 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0b57d2a5-9ceb-4779-9857-3abd22e905c8" returned: 0 in 0.613s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-quobyte-0b57d2a5-9ceb-4779-9857-3abd22e905c8" released by "delete_volume" :: held 1.404s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Created reservations ['f358c6eb-31ff-4c2d-b959-b6754aa5b20c', '2fd4748e-5ded-49d9-88d9-8ac467a0ce6d', 'd1f69542-15de-4290-8ce1-eabade93adac', '3ca2ab7b-4de2-485b-9455-556bd26b8fdb'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:34 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:34 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:35 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-21cd5b61-28db-4fc6-945f-cf8f28b62347" returned: 0 in 0.605s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.425s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-941189333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45674494-45d2-4c87-8dce-26a925f4ef63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e904fe11c4bf2893bc182ae412bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:25Z,use_quota=True,user_id='279fe4f34cc44d669aeb7c52bd5ec19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Creating volume 45674494-45d2-4c87-8dce-26a925f4ef63 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:35 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-45674494-45d2-4c87-8dce-26a925f4ef63 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86910c9a-79ee-4d7a-b82d-2eab3844dbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21cd5b61-28db-4fc6-945f-cf8f28b62347', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:35 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-45674494-45d2-4c87-8dce-26a925f4ef63 1073741824 Jun 04 13:36:35 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bfa9ad-afb2-4b56-b0d5-e461f62cfd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:35 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume volume-21cd5b61-28db-4fc6-945f-cf8f28b62347 (21cd5b61-28db-4fc6-945f-cf8f28b62347): created successfully Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bfa9ad-afb2-4b56-b0d5-e461f62cfd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Flow 'volume_create_manager' (fe892ffc-9bad-437a-9a23-d0607099a0de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:35 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b2f58fbf-d217-4d60-af4b-40958475c6f0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Created volume successfully. Jun 04 13:36:35 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "cinder-e09bdb8e-c486-42b6-8187-b971570b3278-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.601s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:35 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Deleted volume successfully. Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-e09bdb8e-c486-42b6-8187-b971570b3278-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-9e31006a-4aab-4d87-9220-ce2aae795c8d tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-0b57d2a5-9ceb-4779-9857-3abd22e905c8-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "cinder-quobyte-e09bdb8e-c486-42b6-8187-b971570b3278" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-quobyte-e09bdb8e-c486-42b6-8187-b971570b3278" acquired by "delete_volume" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f974c0e5-9bbb-4697-81a9-ba513b5c79a3]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e09bdb8e-c486-42b6-8187-b971570b3278 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:35 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e09bdb8e-c486-42b6-8187-b971570b3278 Jun 04 13:36:35 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:36 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-45674494-45d2-4c87-8dce-26a925f4ef63 1073741824" returned: 0 in 0.824s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-45674494-45d2-4c87-8dce-26a925f4ef63 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:36 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-45674494-45d2-4c87-8dce-26a925f4ef63 Jun 04 13:36:36 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:36 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e09bdb8e-c486-42b6-8187-b971570b3278" returned: 0 in 0.749s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e09bdb8e-c486-42b6-8187-b971570b3278 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:36 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e09bdb8e-c486-42b6-8187-b971570b3278 Jun 04 13:36:36 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:36 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-45674494-45d2-4c87-8dce-26a925f4ef63" returned: 0 in 0.618s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.567s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1820526898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c916b93-8392-463e-9a4d-ff362914b39a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e904fe11c4bf2893bc182ae412bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:25Z,use_quota=True,user_id='279fe4f34cc44d669aeb7c52bd5ec19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Creating volume 0c916b93-8392-463e-9a4d-ff362914b39a {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:36 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0c916b93-8392-463e-9a4d-ff362914b39a 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:36 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0c916b93-8392-463e-9a4d-ff362914b39a 1073741824 Jun 04 13:36:36 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75af60c5-ea73-424a-8ab9-9601bc65e919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45674494-45d2-4c87-8dce-26a925f4ef63', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf36bd3-ba2d-4802-900e-42fb8bedd745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:36 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume volume-45674494-45d2-4c87-8dce-26a925f4ef63 (45674494-45d2-4c87-8dce-26a925f4ef63): created successfully Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf36bd3-ba2d-4802-900e-42fb8bedd745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:36 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Flow 'volume_create_manager' (91df3abf-4379-4144-a61d-17391b55c7ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:36 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-cadb4a65-85b9-42e6-86b0-422fdc177c4b tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Created volume successfully. Jun 04 13:36:37 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e09bdb8e-c486-42b6-8187-b971570b3278" returned: 0 in 0.634s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-quobyte-e09bdb8e-c486-42b6-8187-b971570b3278" released by "delete_volume" :: held 1.436s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Created reservations ['7860a762-3804-4837-a555-b0a4616f3038', '1f06e96e-f749-44ca-86bf-81b96f270002', 'ec06c7d6-869d-4799-aa89-7c8968698731', 'ab7fcc1b-8679-41a7-85c2-3c89047616e9'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:37 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:37 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:37 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0c916b93-8392-463e-9a4d-ff362914b39a 1073741824" returned: 0 in 0.835s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0c916b93-8392-463e-9a4d-ff362914b39a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:37 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0c916b93-8392-463e-9a4d-ff362914b39a Jun 04 13:36:37 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "cinder-05f9914b-359d-41f7-a2d4-6fc8105d4648-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:37 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.646s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-05f9914b-359d-41f7-a2d4-6fc8105d4648-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:37 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Deleted volume successfully. Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0b869ca3-56b8-4ff3-9e46-661828f097e8 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-e09bdb8e-c486-42b6-8187-b971570b3278-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "cinder-quobyte-05f9914b-359d-41f7-a2d4-6fc8105d4648" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-quobyte-05f9914b-359d-41f7-a2d4-6fc8105d4648" acquired by "delete_volume" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc93e51-2bc1-45b8-9499-55313a0b82cd]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-05f9914b-359d-41f7-a2d4-6fc8105d4648 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:38 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-05f9914b-359d-41f7-a2d4-6fc8105d4648 Jun 04 13:36:38 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:38 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0c916b93-8392-463e-9a4d-ff362914b39a" returned: 0 in 0.645s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.489s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-132711244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd705287-9307-496d-9a51-8ba290adcc10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f6e904fe11c4bf2893bc182ae412bd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:26Z,use_quota=True,user_id='279fe4f34cc44d669aeb7c52bd5ec19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Creating volume cd705287-9307-496d-9a51-8ba290adcc10 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:38 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cd705287-9307-496d-9a51-8ba290adcc10 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecd3e8c-271d-42e0-9539-27d11c755524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c916b93-8392-463e-9a4d-ff362914b39a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:38 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cd705287-9307-496d-9a51-8ba290adcc10 1073741824 Jun 04 13:36:38 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3689e133-f951-498d-89f7-2a0687142874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:38 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume volume-0c916b93-8392-463e-9a4d-ff362914b39a (0c916b93-8392-463e-9a4d-ff362914b39a): created successfully Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3689e133-f951-498d-89f7-2a0687142874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Flow 'volume_create_manager' (a50cfca9-74af-4570-ba7d-499d43696661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:38 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-cfaa8c4c-b1e4-4355-84b3-33c9356d9ba5 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Created volume successfully. Jun 04 13:36:38 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-05f9914b-359d-41f7-a2d4-6fc8105d4648" returned: 0 in 0.743s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-05f9914b-359d-41f7-a2d4-6fc8105d4648 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:38 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-05f9914b-359d-41f7-a2d4-6fc8105d4648 Jun 04 13:36:38 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:39 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cd705287-9307-496d-9a51-8ba290adcc10 1073741824" returned: 0 in 0.764s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cd705287-9307-496d-9a51-8ba290adcc10 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:39 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cd705287-9307-496d-9a51-8ba290adcc10 Jun 04 13:36:39 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:39 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-05f9914b-359d-41f7-a2d4-6fc8105d4648" returned: 0 in 0.605s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-quobyte-05f9914b-359d-41f7-a2d4-6fc8105d4648" released by "delete_volume" :: held 1.408s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Created reservations ['4c47b7a5-54b3-4705-a353-ea73e814b8be', 'f402d1cb-0bc7-47ef-9e95-87436cb0670f', 'bbc33de5-50c5-4b6a-a852-d94d6706c641', '33f0ea2a-08dc-4abb-9487-10f9a39f1dad'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:39 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:39 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:39 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cd705287-9307-496d-9a51-8ba290adcc10" returned: 0 in 0.610s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.580s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b097e3-6719-49ef-8eca-fcd2ecda8ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2bd5d169f544082acc1c4230e781058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:26Z,use_quota=True,user_id='9e70a5862cd344ec9b9d95c3cc4a3b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(82fdae47-4a68-4534-a23f-f1c96ffd85b4),volume_type_id=82fdae47-4a68-4534-a23f-f1c96ffd85b4)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Creating volume c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:39 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76fa47a-23a0-4ad5-ad06-b3124d861da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd705287-9307-496d-9a51-8ba290adcc10', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:39 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 1073741824 Jun 04 13:36:39 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdc575e-70d8-40ee-96b6-ec45016fb11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:39 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Volume volume-cd705287-9307-496d-9a51-8ba290adcc10 (cd705287-9307-496d-9a51-8ba290adcc10): created successfully Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bdc575e-70d8-40ee-96b6-ec45016fb11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:39 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Flow 'volume_create_manager' (c38bff03-c54b-4a15-8359-04c440d9c445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-8da007c7-78b1-43c6-9b68-640526999168 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Created volume successfully. Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "cinder-cc474f90-1289-4733-b78f-c0c47b25732a-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:40 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.633s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-cc474f90-1289-4733-b78f-c0c47b25732a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:40 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Deleted volume successfully. Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-30b92903-d684-4b8b-b81c-10b3846370a0 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-05f9914b-359d-41f7-a2d4-6fc8105d4648-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "cinder-quobyte-cc474f90-1289-4733-b78f-c0c47b25732a" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-quobyte-cc474f90-1289-4733-b78f-c0c47b25732a" acquired by "delete_volume" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bc8ab1-791d-4af8-a52b-c07d1f340ccc]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cc474f90-1289-4733-b78f-c0c47b25732a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:40 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cc474f90-1289-4733-b78f-c0c47b25732a Jun 04 13:36:40 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:40 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 1073741824" returned: 0 in 0.799s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:40 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 Jun 04 13:36:40 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "cinder-cd705287-9307-496d-9a51-8ba290adcc10-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-cd705287-9307-496d-9a51-8ba290adcc10-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "cinder-quobyte-cd705287-9307-496d-9a51-8ba290adcc10" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-quobyte-cd705287-9307-496d-9a51-8ba290adcc10" acquired by "delete_volume" :: waited 0.014s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ff62c5-a2f0-4ce0-b301-113ce1b397c1]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cd705287-9307-496d-9a51-8ba290adcc10 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:40 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cc474f90-1289-4733-b78f-c0c47b25732a" returned: 0 in 0.774s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:40 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cc474f90-1289-4733-b78f-c0c47b25732a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:40 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cc474f90-1289-4733-b78f-c0c47b25732a Jun 04 13:36:40 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:41 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cd705287-9307-496d-9a51-8ba290adcc10 Jun 04 13:36:41 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:41 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2" returned: 0 in 0.675s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.932s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1828952910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca865481-5dc0-4560-a1dd-c2a6792cd457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='161dd02fb82f4ccc83b4cf944020fd6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:29Z,use_quota=True,user_id='43700ed321a3413aaa38436347b1bd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Creating volume ca865481-5dc0-4560-a1dd-c2a6792cd457 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:41 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:41 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 1073741824 Jun 04 13:36:41 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Attempting download of 65490922-ac96-481a-951c-15b5bbc4a51c ((None, [{'url': 'file:///opt/stack/data/glance/images/65490922-ac96-481a-951c-15b5bbc4a51c', 'metadata': {}}])) to volume c6b097e3-6719-49ef-8eca-fcd2ecda8ad2. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[e170f14c-4bce-48f3-9eee-6e8c5f7c468f]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65490922-ac96-481a-951c-15b5bbc4a51c_egido0po {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:41 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65490922-ac96-481a-951c-15b5bbc4a51c_egido0po Jun 04 13:36:41 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:41 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cc474f90-1289-4733-b78f-c0c47b25732a" returned: 0 in 0.703s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:41 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cd705287-9307-496d-9a51-8ba290adcc10" returned: 0 in 0.745s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cd705287-9307-496d-9a51-8ba290adcc10 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-quobyte-cc474f90-1289-4733-b78f-c0c47b25732a" released by "delete_volume" :: held 1.531s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:41 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cd705287-9307-496d-9a51-8ba290adcc10 Jun 04 13:36:41 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Created reservations ['37a78764-4c2e-4409-a85e-ed8d18df0198', 'a5be7eae-f6f7-446f-9d52-36e8d0337307', 'd462f008-44b7-43fb-92df-eaef99474fd7', 'c2d0d2cd-f829-478a-a15b-40ce2372ff4c'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:41 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:41 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:41 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:42 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65490922-ac96-481a-951c-15b5bbc4a51c_egido0po" returned: 0 in 0.777s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65490922-ac96-481a-951c-15b5bbc4a51c_egido0po {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "cinder-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:42 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 1073741824" returned: 0 in 1.033s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:42 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65490922-ac96-481a-951c-15b5bbc4a51c_egido0po Jun 04 13:36:42 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "cinder-quobyte-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-quobyte-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d" acquired by "delete_volume" :: waited 0.030s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8db5860-39d1-4681-a0c4-d9b38da1e9f6]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:42 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 Jun 04 13:36:42 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:42 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-cd705287-9307-496d-9a51-8ba290adcc10" returned: 0 in 0.901s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:42 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.731s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-quobyte-cd705287-9307-496d-9a51-8ba290adcc10" released by "delete_volume" :: held 1.709s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:42 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Deleted volume successfully. Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6c4ac091-266c-40a8-9cfb-85e63d12e0a9 tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-cc474f90-1289-4733-b78f-c0c47b25732a-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Created reservations ['9af5e938-ddb0-4ef8-87df-a2320c180628', '8366d12c-1fb1-49c9-b168-f8facc620d42', '66d3e8fa-ba24-488c-84b5-7d1bfd9a098e', '9f0ce030-1327-4a8e-956d-1aabe83e8687'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:42 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d Jun 04 13:36:42 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:42 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:42 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:43 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65490922-ac96-481a-951c-15b5bbc4a51c_egido0po" returned: 1 in 0.790s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65490922-ac96-481a-951c-15b5bbc4a51c_egido0po' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e6cfb8-bef1-40fc-8871-74d515d3e5b4]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "cinder-0c916b93-8392-463e-9a4d-ff362914b39a-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-0c916b93-8392-463e-9a4d-ff362914b39a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "cinder-quobyte-0c916b93-8392-463e-9a4d-ff362914b39a" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-quobyte-0c916b93-8392-463e-9a4d-ff362914b39a" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:43 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457" returned: 0 in 0.824s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1797cbd-9780-442c-ac09-a67477762f30]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0c916b93-8392-463e-9a4d-ff362914b39a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:43 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD Jun 04 13:36:43 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589c449b-c0e2-4f0a-b38c-33330c055fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca865481-5dc0-4560-a1dd-c2a6792cd457', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6fb45c-f3e6-4431-b90f-2349a3ca147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:43 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Volume volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 (ca865481-5dc0-4560-a1dd-c2a6792cd457): created successfully Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6fb45c-f3e6-4431-b90f-2349a3ca147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Flow 'volume_create_manager' (5615042e-fcf1-4685-a99b-f2862628696a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:43 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a2ca4a77-9770-4952-a98e-723fe62c7cb6 tempest-CinderUnicodeTest-1707824945 None] Created volume successfully. Jun 04 13:36:43 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0c916b93-8392-463e-9a4d-ff362914b39a Jun 04 13:36:43 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:43 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d" returned: 0 in 0.982s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:43 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.812s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:43 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d Jun 04 13:36:43 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:43 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Deleted volume successfully. Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fd571247-f18c-46c2-83de-a98de114f3b0 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-cd705287-9307-496d-9a51-8ba290adcc10-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:43 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:44 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD Jun 04 13:36:44 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:44 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d" returned: 0 in 0.609s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:44 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0c916b93-8392-463e-9a4d-ff362914b39a" returned: 0 in 0.798s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0c916b93-8392-463e-9a4d-ff362914b39a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-quobyte-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d" released by "delete_volume" :: held 1.664s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:44 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0c916b93-8392-463e-9a4d-ff362914b39a Jun 04 13:36:44 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Created reservations ['356c57cd-5aa3-4d65-8126-b2cce7e77946', '60dde855-ad12-4f92-a3ad-391cfe1ecfde', '4f4c3fdd-deff-4c48-b0af-4cf92bdbc2bd', 'e058129e-d2fc-4988-9b02-8aa274749a73'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:44 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:44 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] Creating offline snapshot 9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 of volume ca865481-5dc0-4560-a1dd-c2a6792cd457 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[329339e4-4f35-4224-9def-17736a907df9]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:44 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD" returned: 1 in 0.890s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] 65490922-ac96-481a-951c-15b5bbc4a51c was raw, converting to raw {{(pid=86722) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:44 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 Jun 04 13:36:44 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:44 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-0c916b93-8392-463e-9a4d-ff362914b39a" returned: 0 in 0.797s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:44 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-quobyte-0c916b93-8392-463e-9a4d-ff362914b39a" released by "delete_volume" :: held 1.660s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:45 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 Jun 04 13:36:45 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Created reservations ['42f5d18c-95e1-4910-a874-14ceb30e1f18', 'aa3230d2-60da-4942-aa40-fccf2ad6a407', '5bcfb826-3071-4929-84d6-15df02ba0cf3', 'f4de5189-c293-40ac-9592-228485206e5a'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:45 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.942s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Deleted volume successfully. Jun 04 13:36:45 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:45 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-366d714c-b083-48d1-8203-94d36ffb6dfd tempest-CreateVolumesFromImageTest-2086404461 None] Lock "cinder-a6a1741d-6650-4fb7-ae53-2cc9a218ba4d-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "cinder-45674494-45d2-4c87-8dce-26a925f4ef63-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-45674494-45d2-4c87-8dce-26a925f4ef63-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "cinder-quobyte-45674494-45d2-4c87-8dce-26a925f4ef63" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-quobyte-45674494-45d2-4c87-8dce-26a925f4ef63" acquired by "delete_volume" :: waited 0.038s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b07dec9-c054-4ad3-ad86-6efe1971469c]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-45674494-45d2-4c87-8dce-26a925f4ef63 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:45 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-45674494-45d2-4c87-8dce-26a925f4ef63 Jun 04 13:36:45 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:45 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2" returned: 0 in 1.072s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65490922-ac96-481a-951c-15b5bbc4a51c_q4_mhanndevstack@QuobyteHD, size 0.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:36:45 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Converted 0.00 MB image at 0.00 MB/s Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:45 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.780s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:45 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:45 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Deleted volume successfully. Jun 04 13:36:46 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 1G Jun 04 13:36:46 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-062597ea-0898-4ed0-888f-35d148afa9ea tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-0c916b93-8392-463e-9a4d-ff362914b39a-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:46 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457" returned: 0 in 1.323s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:46 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 1G Jun 04 13:36:46 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:46 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-45674494-45d2-4c87-8dce-26a925f4ef63" returned: 0 in 0.947s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-45674494-45d2-4c87-8dce-26a925f4ef63 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:46 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-45674494-45d2-4c87-8dce-26a925f4ef63 Jun 04 13:36:46 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:46 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 1G" returned: 0 in 0.918s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9229c786-6f8b-4553-95cf-c596342535ad]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:47 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 Jun 04 13:36:47 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:47 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 1G" returned: 0 in 1.013s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:47 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 Jun 04 13:36:47 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:47 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-45674494-45d2-4c87-8dce-26a925f4ef63" returned: 0 in 0.746s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-quobyte-45674494-45d2-4c87-8dce-26a925f4ef63" released by "delete_volume" :: held 1.753s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Created reservations ['309836ab-56c0-4a03-88ad-a3270e887fff', '4b753d7c-07a5-4b11-8c82-d65ff55aff31', '09d3b0a4-2292-4f74-afd1-f44b208ab5fc', '70e58f90-7817-4c3b-a2e2-564739c6c721'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:47 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:47 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:47 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2" returned: 0 in 0.877s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "cinder-21cd5b61-28db-4fc6-945f-cf8f28b62347-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-21cd5b61-28db-4fc6-945f-cf8f28b62347-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:47 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 Jun 04 13:36:47 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:48 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "cinder-quobyte-21cd5b61-28db-4fc6-945f-cf8f28b62347" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355" returned: 0 in 0.875s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:48 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 is being set with open permissions: ugo+rw Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-quobyte-21cd5b61-28db-4fc6-945f-cf8f28b62347" acquired by "delete_volume" :: waited 0.030s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:48 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 Jun 04 13:36:48 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[99733ea6-a79b-4d0a-9cee-2fa47f314596]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-21cd5b61-28db-4fc6-945f-cf8f28b62347 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:48 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-21cd5b61-28db-4fc6-945f-cf8f28b62347 Jun 04 13:36:48 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:48 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.870s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:48 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Deleted volume successfully. Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ea2c637-2508-4f15-9e78-15955e80cec4 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-45674494-45d2-4c87-8dce-26a925f4ef63-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:48 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2" returned: 1 in 0.906s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Downloaded image 65490922-ac96-481a-951c-15b5bbc4a51c ((None, [{'url': 'file:///opt/stack/data/glance/images/65490922-ac96-481a-951c-15b5bbc4a51c', 'metadata': {}}])) to volume c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 successfully. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Temporary image 65490922-ac96-481a-951c-15b5bbc4a51c for user 9e70a5862cd344ec9b9d95c3cc4a3b79 is deleted. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Marking volume c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 as bootable. {{(pid=86722) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Copying metadata from image 65490922-ac96-481a-951c-15b5bbc4a51c to c6b097e3-6719-49ef-8eca-fcd2ecda8ad2. {{(pid=86722) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Creating volume glance metadata for volume c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 backed by image 65490922-ac96-481a-951c-15b5bbc4a51c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '65490922-ac96-481a-951c-15b5bbc4a51c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '83f2ef53d795e7ad638c5731e46e4def', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86722) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 13:36:48 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355" returned: 0 in 0.728s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:48 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.info Jun 04 13:36:48 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37ba70b-c4de-458c-aaa3-fdd499e40539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2', 'volume_size': 1, 'image_id': '65490922-ac96-481a-951c-15b5bbc4a51c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65490922-ac96-481a-951c-15b5bbc4a51c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '83f2ef53d795e7ad638c5731e46e4def', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2bd5d169f544082acc1c4230e781058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0480f7732315dcf27c69c2e1eb160cc05d735b9e156ed25054577c27681af4bbfed0751c0178fc519ab9a74df5375bdf1b2c12a49d95f988cbe6d9b6afdf4bff', 'id': '65490922-ac96-481a-951c-15b5bbc4a51c', 'created_at': datetime.datetime(2026, 6, 4, 11, 36, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 36, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65490922-ac96-481a-951c-15b5bbc4a51c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d61828f-7e65-4621-bb03-7aaf52952d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:48 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Volume volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 (c6b097e3-6719-49ef-8eca-fcd2ecda8ad2): created successfully Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d61828f-7e65-4621-bb03-7aaf52952d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Flow 'volume_create_manager' (6e874bee-f303-4789-89ae-4359b06701b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:48 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6b9571fe-9961-4e03-be72-6f70ec11d44d tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Created volume successfully. Jun 04 13:36:48 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-21cd5b61-28db-4fc6-945f-cf8f28b62347" returned: 0 in 0.866s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-21cd5b61-28db-4fc6-945f-cf8f28b62347 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:48 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-21cd5b61-28db-4fc6-945f-cf8f28b62347 Jun 04 13:36:48 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:49 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.info" returned: 0 in 0.656s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:49 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.info is being set with open permissions: ugo+rw Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:49 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.info Jun 04 13:36:49 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:49 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-21cd5b61-28db-4fc6-945f-cf8f28b62347" returned: 0 in 0.634s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-quobyte-21cd5b61-28db-4fc6-945f-cf8f28b62347" released by "delete_volume" :: held 1.553s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Acquiring lock "cinder-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Lock "cinder-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Created reservations ['5db8a841-23f3-47ce-9224-f0c776f7d87d', 'd4807e91-1636-431d-ab0c-0bfdeed32080', '48e51ecd-e439-481f-9082-ac6533bbb012', '4b2e8535-bec0-45f4-8fef-af61c7e4441e'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Acquiring lock "cinder-quobyte-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Lock "cinder-quobyte-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2" acquired by "delete_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd534648-1a6b-48e6-997c-6e9d72a626a1]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:49 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:49 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:49 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 Jun 04 13:36:49 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:50 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.info" returned: 0 in 0.670s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.399s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:50 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-9a365613-e61c-4663-a661-24c16f0e64e4 tempest-CinderUnicodeTest-1707824945 None] Create snapshot completed successfully Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "cinder-dcd009f9-99d3-46f1-8fc7-55ff6db736bc-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-dcd009f9-99d3-46f1-8fc7-55ff6db736bc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "cinder-quobyte-dcd009f9-99d3-46f1-8fc7-55ff6db736bc" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-quobyte-dcd009f9-99d3-46f1-8fc7-55ff6db736bc" acquired by "delete_volume" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7385e7-8bfe-41e4-b687-5510f5ade2f6]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:50 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc Jun 04 13:36:50 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:50 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.816s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:50 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Deleted volume successfully. Jun 04 13:36:50 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2" returned: 0 in 0.838s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:50 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-41919e70-0dfa-4733-99b4-7ca223808ee9 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-21cd5b61-28db-4fc6-945f-cf8f28b62347-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:50 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 Jun 04 13:36:50 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "cinder-9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "cinder-quobyte-ca865481-5dc0-4560-a1dd-c2a6792cd457" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-quobyte-ca865481-5dc0-4560-a1dd-c2a6792cd457" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "cinder-quobyte-9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-quobyte-9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Deleting offline snapshot 9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 of volume ca865481-5dc0-4560-a1dd-c2a6792cd457 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:36:51 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] snapshot_file for this snap is: volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc" returned: 0 in 0.841s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e82d406-0137-408d-91de-810158ea38e6]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:51 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc Jun 04 13:36:51 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:51 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 Jun 04 13:36:51 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:51 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Flow 'volume_create_manager' (4300b165-ba39-4916-a008-0248b593f457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af14a3f1-a693-4962-9acf-75642573d6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2" returned: 1 in 0.849s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af14a3f1-a693-4962-9acf-75642573d6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc9668d-bfbd-49d0-ad7f-28cc20fb883b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17fa31993bce4e44ade8b9119b3499e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:51Z,use_quota=True,user_id='8c3bccf0010b485285ebb98649e4419e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:51 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2 Jun 04 13:36:51 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aead1a45-7f8f-4fa2-a227-7e5aaee96b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aead1a45-7f8f-4fa2-a227-7e5aaee96b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157c9d04-15aa-4731-ad29-ab192dbf6514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.image.glance [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Creating Keystone auth plugin from conf {{(pid=86722) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (157c9d04-15aa-4731-ad29-ab192dbf6514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1fc9668d-bfbd-49d0-ad7f-28cc20fb883b', 'volume_name': 'volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b', 'volume_size': 1, 'image_id': '88495831-0a2d-4e00-94a4-e0c09cf62505', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88495831-0a2d-4e00-94a4-e0c09cf62505', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff99816ea72c7da3902de5ef5817c49f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17fa31993bce4e44ade8b9119b3499e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59df8de81fc18c1d199f0c3f49e9d443b835c71186256996bcf7a2d02a5ad89f149f032bbf3c3675a73c6c57ed0fae21a9eedac76ff564453607aa3b1a9b10a4', 'id': '88495831-0a2d-4e00-94a4-e0c09cf62505', 'created_at': datetime.datetime(2026, 6, 4, 11, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88495831-0a2d-4e00-94a4-e0c09cf62505/file', 'properties': {}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad9ae783-3d6b-41de-9775-e957a3c5612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad9ae783-3d6b-41de-9775-e957a3c5612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76caf1f2-e5a3-49ca-9566-2d08d1623139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:51 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Volume 1fc9668d-bfbd-49d0-ad7f-28cc20fb883b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b', 'volume_size': 1, 'image_id': '88495831-0a2d-4e00-94a4-e0c09cf62505', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88495831-0a2d-4e00-94a4-e0c09cf62505', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff99816ea72c7da3902de5ef5817c49f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17fa31993bce4e44ade8b9119b3499e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59df8de81fc18c1d199f0c3f49e9d443b835c71186256996bcf7a2d02a5ad89f149f032bbf3c3675a73c6c57ed0fae21a9eedac76ff564453607aa3b1a9b10a4', 'id': '88495831-0a2d-4e00-94a4-e0c09cf62505', 'created_at': datetime.datetime(2026, 6, 4, 11, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88495831-0a2d-4e00-94a4-e0c09cf62505/file', 'properties': {}}, 'image_service': } Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Trying to clone 1fc9668d-bfbd-49d0-ad7f-28cc20fb883b from image 88495831-0a2d-4e00-94a4-e0c09cf62505 at location (None, [{'url': 'file:///opt/stack/data/glance/images/88495831-0a2d-4e00-94a4-e0c09cf62505', 'metadata': {}}]). {{(pid=86722) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Jun 04 13:36:51 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-dcd009f9-99d3-46f1-8fc7-55ff6db736bc" returned: 0 in 0.785s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:51 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 04 13:36:51 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Image download 0.00 MB at 0.00 MB/s Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-quobyte-dcd009f9-99d3-46f1-8fc7-55ff6db736bc" released by "delete_volume" :: held 1.687s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd70c23-fb89-4ddf-a208-41385ac1f54d]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:52 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355" returned: 0 in 0.864s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca865481-5dc0-4560-a1dd-c2a6792cd457(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5952e727-830e-4bf8-934c-d0a8b07fbb10]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Created reservations ['73a39cbd-b8f3-4e66-b60d-8edfafa43836', 'b6003457-3bcb-495b-938e-23acb01764c9', '2eca5779-8bc5-4691-a86c-f3072633b6e4', '00e1db16-6c41-4423-821b-046b2d2abfa1'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:52 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD Jun 04 13:36:52 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:52 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:52 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:52 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:52 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:52 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2" returned: 0 in 0.753s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Lock "cinder-quobyte-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2" released by "delete_volume" :: held 2.534s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Created reservations ['2ec5cb3f-8e86-4c47-8372-a5fdd49ef60d', '1fbe3e83-642d-4c61-8323-af9d6e039da8', 'e85a91a1-549a-433c-be68-4f29fb0090e4', 'aced9d38-1dc0-4e52-a2da-3bc29571b4a7'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:52 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:52 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "cinder-d413bbf2-70d1-490a-8dae-e1bfc5bef549-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-d413bbf2-70d1-490a-8dae-e1bfc5bef549-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "cinder-quobyte-d413bbf2-70d1-490a-8dae-e1bfc5bef549" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-quobyte-d413bbf2-70d1-490a-8dae-e1bfc5bef549" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[296c450d-83ea-46a1-a3d1-d3ada52417dc]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:53 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD" returned: 0 in 0.978s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:53 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:53 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549 Jun 04 13:36:53 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.825s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:53 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:53 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Deleted volume successfully. Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457" returned: 0 in 0.972s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a3e1daf3-8e8f-4ade-8985-6d44b3a1e880 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-dcd009f9-99d3-46f1-8fc7-55ff6db736bc-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:53 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 Jun 04 13:36:53 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:53 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD Jun 04 13:36:53 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:53 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.957s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:53 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Deleted volume successfully. Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-3c093e3f-955b-4a85-8e63-b07d67bc0838 tempest-VolumeAndVolumeTypeFromImageTest-424178904 None] Lock "cinder-c6b097e3-6719-49ef-8eca-fcd2ecda8ad2-delete_volume" released by "delete_volume" :: held 3.754s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:53 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549" returned: 0 in 1.078s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:53 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549 Jun 04 13:36:53 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:53 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD" returned: 1 in 0.902s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:36:53 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Temporary image 88495831-0a2d-4e00-94a4-e0c09cf62505 is fetched for user 8c3bccf0010b485285ebb98649e4419e. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce33538a-6a38-46dd-ac84-3de8aa53a9c6]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:54 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355" returned: 0 in 0.979s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:54 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355 Jun 04 13:36:54 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:54 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD Jun 04 13:36:54 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:54 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-d413bbf2-70d1-490a-8dae-e1bfc5bef549" returned: 0 in 0.738s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-quobyte-d413bbf2-70d1-490a-8dae-e1bfc5bef549" released by "delete_volume" :: held 1.892s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Created reservations ['c665c8ec-cb86-4ebd-8168-930b6bc0167c', 'abe79350-81c2-46b0-be65-77d99d549dcc', 'f11fe8fb-dd59-4cc7-9740-fef0dcfab00a', '1c529456-947c-4f9c-856d-2b3292abdba8'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:54 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457.9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355" returned: 0 in 0.790s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:54 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD" returned: 0 in 0.899s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-quobyte-9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355" released by "_delete_snapshot" :: held 3.786s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-quobyte-ca865481-5dc0-4560-a1dd-c2a6792cd457" released by "delete_snapshot" :: held 3.831s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:55 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:55 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:55 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD Jun 04 13:36:55 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Created reservations ['453f1d7a-30a8-4b34-a4cd-ee742f7593ec', '46e3ca07-e705-405b-9b0b-4fce78fa9d0c', '8a158756-11d9-4efc-a121-dacc760b0d97', '099bd7ad-e7e4-4449-8e50-4db8cd14ddc0'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:55 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Delete snapshot completed successfully. Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ef2df966-3e0a-4a54-a7fa-7c629523c2cb tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-9cd1e1ef-74d1-40d5-827e-3b1e8f4dc355-delete_snapshot" released by "delete_snapshot" :: held 4.111s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "cinder-ca865481-5dc0-4560-a1dd-c2a6792cd457-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-ca865481-5dc0-4560-a1dd-c2a6792cd457-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "cinder-quobyte-ca865481-5dc0-4560-a1dd-c2a6792cd457" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-quobyte-ca865481-5dc0-4560-a1dd-c2a6792cd457" acquired by "delete_volume" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c1c5fd-5932-4849-859b-cf893651fe7b]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:55 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 Jun 04 13:36:55 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:55 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD" returned: 1 in 0.960s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc9668d-bfbd-49d0-ad7f-28cc20fb883b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17fa31993bce4e44ade8b9119b3499e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:51Z,use_quota=True,user_id='8c3bccf0010b485285ebb98649e4419e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Creating volume 1fc9668d-bfbd-49d0-ad7f-28cc20fb883b {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:55 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:55 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:55 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b 1073741824 Jun 04 13:36:55 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:56 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.053s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:56 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:56 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Deleted volume successfully. Jun 04 13:36:56 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f713fcf7-8cf4-4886-a24c-3ab319a2d2b2 tempest-CreateVolumesFromSourceVolumeTest-227203571 None] Lock "cinder-d413bbf2-70d1-490a-8dae-e1bfc5bef549-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:56 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457" returned: 0 in 0.960s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:56 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457 Jun 04 13:36:56 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:56 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b 1073741824" returned: 0 in 1.036s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:56 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:57 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b Jun 04 13:36:57 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:57 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ca865481-5dc0-4560-a1dd-c2a6792cd457" returned: 0 in 0.786s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-quobyte-ca865481-5dc0-4560-a1dd-c2a6792cd457" released by "delete_volume" :: held 1.840s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Created reservations ['d36c8823-6239-4112-a5c9-18ca2de97d4b', 'bb12bc63-1ea7-43df-ba97-932c07fc3027', '9fda0e3f-8f71-468b-be44-39a2a4554565', 'ff8e6f71-e5bd-43cc-ac73-4117d0f641a5'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:57 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:36:57 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:57 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b" returned: 0 in 0.771s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Attempting download of 88495831-0a2d-4e00-94a4-e0c09cf62505 ((None, [{'url': 'file:///opt/stack/data/glance/images/88495831-0a2d-4e00-94a4-e0c09cf62505', 'metadata': {}}])) to volume 1fc9668d-bfbd-49d0-ad7f-28cc20fb883b. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "cinder-a1e0a0c9-6d06-4933-a41c-f722b95d26e5-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-a1e0a0c9-6d06-4933-a41c-f722b95d26e5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5750b9b8-c284-4ff8-8330-bcdcf947b8cc]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88495831-0a2d-4e00-94a4-e0c09cf62505_nq04n86h {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "cinder-quobyte-a1e0a0c9-6d06-4933-a41c-f722b95d26e5" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:36:57 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-quobyte-a1e0a0c9-6d06-4933-a41c-f722b95d26e5" acquired by "delete_volume" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f68b1fe-9150-45f5-b7fc-5b4c481c4f61]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:58 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88495831-0a2d-4e00-94a4-e0c09cf62505_nq04n86h Jun 04 13:36:58 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:58 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5 Jun 04 13:36:58 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:58 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.894s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:36:58 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Deleted volume successfully. Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-edb18e2f-7a8a-464d-950c-71e2d124ba82 tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-ca865481-5dc0-4560-a1dd-c2a6792cd457-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Flow 'volume_create_manager' (80fda7f0-b5c6-4cf1-aa2d-41b975ca8ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc8bdd0-5682-44bb-8f79-8c9f3e2d477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc8bdd0-5682-44bb-8f79-8c9f3e2d477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1684923537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f483995-49ff-4d6d-91e9-a1b44226338d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0982f21280a84032ae59e0a3f7a05437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:59Z,use_quota=True,user_id='b454e890ea0d4c6d94aa217dfa179e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e011dab4-dd1c-4935-a489-949c5fd13a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e011dab4-dd1c-4935-a489-949c5fd13a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c44eb7f-6e1a-48f9-be27-2bfe731cb9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c44eb7f-6e1a-48f9-be27-2bfe731cb9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f483995-49ff-4d6d-91e9-a1b44226338d', 'volume_name': 'volume-8f483995-49ff-4d6d-91e9-a1b44226338d', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1bf79e-88e2-4701-a692-f37564c678bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1bf79e-88e2-4701-a692-f37564c678bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06505078-57cb-4499-bd7e-57f122b347f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:58 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Volume 8f483995-49ff-4d6d-91e9-a1b44226338d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f483995-49ff-4d6d-91e9-a1b44226338d', 'volume_size': 1} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1684923537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f483995-49ff-4d6d-91e9-a1b44226338d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0982f21280a84032ae59e0a3f7a05437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:59Z,use_quota=True,user_id='b454e890ea0d4c6d94aa217dfa179e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Creating volume 8f483995-49ff-4d6d-91e9-a1b44226338d {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:36:58 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:36:58 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:58 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d 1073741824 Jun 04 13:36:58 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:59 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5" returned: 0 in 1.020s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:59 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5 Jun 04 13:36:59 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:59 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_88495831-0a2d-4e00-94a4-e0c09cf62505_nq04n86h" returned: 0 in 1.377s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88495831-0a2d-4e00-94a4-e0c09cf62505_nq04n86h {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Flow 'volume_create_manager' (a9e800a0-33e0-43e3-9590-84194dc5a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f241171-6919-4436-ae2f-7e365c15f40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f241171-6919-4436-ae2f-7e365c15f40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922416474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2061a90-2cc0-461b-9d6d-d13d1ef23b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16497c80d327476ba0208ecee77e2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:59Z,use_quota=True,user_id='a5aa2a70499549d3a0881d68e29c4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28bc5e7-22e3-4816-9fb0-2cd943487b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d28bc5e7-22e3-4816-9fb0-2cd943487b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:59 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88495831-0a2d-4e00-94a4-e0c09cf62505_nq04n86h Jun 04 13:36:59 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9148df4-198b-44cd-9a2e-8469d1d410d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9148df4-198b-44cd-9a2e-8469d1d410d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2061a90-2cc0-461b-9d6d-d13d1ef23b79', 'volume_name': 'volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db5f19f-e091-4a5c-9aa1-0511454cf61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db5f19f-e091-4a5c-9aa1-0511454cf61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec8d105-3e8e-4179-8690-1b1b6b5c1dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:36:59 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume e2061a90-2cc0-461b-9d6d-d13d1ef23b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79', 'volume_size': 1} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:36:59 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d 1073741824" returned: 0 in 1.056s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:36:59 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a1e0a0c9-6d06-4933-a41c-f722b95d26e5" returned: 0 in 0.796s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:36:59 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d Jun 04 13:36:59 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-quobyte-a1e0a0c9-6d06-4933-a41c-f722b95d26e5" released by "delete_volume" :: held 1.934s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:36:59 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Created reservations ['381489dc-82f1-4890-a30c-9713205d8244', '97eee164-78c5-46f3-a93e-22f3270529a0', 'cffd29da-1ca6-4603-9660-991d010d65b6', 'b2263bba-4772-4f9a-aa19-68a74ff599c4'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:00 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88495831-0a2d-4e00-94a4-e0c09cf62505_nq04n86h" returned: 1 in 0.738s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_88495831-0a2d-4e00-94a4-e0c09cf62505_nq04n86h' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c63472-de49-4ff5-9a25-359c9373ab9f]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:00 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:00 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:00 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD Jun 04 13:37:00 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:00 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d" returned: 0 in 0.755s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-922416474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2061a90-2cc0-461b-9d6d-d13d1ef23b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16497c80d327476ba0208ecee77e2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:36:59Z,use_quota=True,user_id='a5aa2a70499549d3a0881d68e29c4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Creating volume e2061a90-2cc0-461b-9d6d-d13d1ef23b79 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:37:00 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06505078-57cb-4499-bd7e-57f122b347f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f483995-49ff-4d6d-91e9-a1b44226338d', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:00 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 1073741824 Jun 04 13:37:00 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c49b095-626a-44aa-b86e-5cf62884712f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:00 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Volume volume-8f483995-49ff-4d6d-91e9-a1b44226338d (8f483995-49ff-4d6d-91e9-a1b44226338d): created successfully Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c49b095-626a-44aa-b86e-5cf62884712f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Flow 'volume_create_manager' (80fda7f0-b5c6-4cf1-aa2d-41b975ca8ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:00 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6abcb895-3d95-4bbd-af64-640a108b4ead tempest-VolumeDependencyTests-1662757146 None] Created volume successfully. Jun 04 13:37:00 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.716s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:00 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Deleted volume successfully. Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7180a45c-478e-427b-92ff-3120502fda53 tempest-CinderUnicodeTest-1707824945 None] Lock "cinder-a1e0a0c9-6d06-4933-a41c-f722b95d26e5-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:00 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD" returned: 0 in 0.900s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:00 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:01 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD Jun 04 13:37:01 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:01 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 1073741824" returned: 0 in 0.958s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:01 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 Jun 04 13:37:01 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:01 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD" returned: 1 in 0.776s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:37:01 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] 88495831-0a2d-4e00-94a4-e0c09cf62505 was raw, converting to raw {{(pid=86722) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 04 13:37:01 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:01 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b Jun 04 13:37:01 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:02 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79" returned: 0 in 0.719s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.372s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec8d105-3e8e-4179-8690-1b1b6b5c1dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c384718-05ff-48be-8996-2a2ba9157cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] Creating offline snapshot d8da6de2-e474-487c-96e7-898541ce2ef1 of volume 8f483995-49ff-4d6d-91e9-a1b44226338d {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:37:02 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 (e2061a90-2cc0-461b-9d6d-d13d1ef23b79): created successfully Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c384718-05ff-48be-8996-2a2ba9157cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Flow 'volume_create_manager' (a9e800a0-33e0-43e3-9590-84194dc5a87e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[85342467-ead0-4bb7-8dd1-d4e7f1ddc855]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:02 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-5750278d-9831-4867-b7b3-7fa574bf0f05 tempest-CreateVolumesFromSnapshotTest-60328812 None] Created volume successfully. Jun 04 13:37:02 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b" returned: 0 in 0.832s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_88495831-0a2d-4e00-94a4-e0c09cf62505_otise4nodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:37:02 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Converted 0.00 MB image at 0.00 MB/s Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:02 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b 1G Jun 04 13:37:02 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:02 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d Jun 04 13:37:02 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:02 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:03 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d" returned: 0 in 0.801s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:03 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 1G Jun 04 13:37:03 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:03 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b 1G" returned: 0 in 0.775s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:03 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d61d0a-2025-49af-817c-9b28a70822a3]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:03 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:03 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b Jun 04 13:37:03 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:04 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 1G" returned: 0 in 0.816s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f483995-49ff-4d6d-91e9-a1b44226338d -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:04 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:04 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:04 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f483995-49ff-4d6d-91e9-a1b44226338d -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 Jun 04 13:37:04 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:04 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b" returned: 0 in 0.898s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:04 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b Jun 04 13:37:04 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:04 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.790s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jun 04 13:37:04 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f483995-49ff-4d6d-91e9-a1b44226338d -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1" returned: 0 in 0.861s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:04 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 is being set with open permissions: ugo+rw Jun 04 13:37:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:04 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 Jun 04 13:37:04 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:05 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b" returned: 1 in 0.828s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Downloaded image 88495831-0a2d-4e00-94a4-e0c09cf62505 ((None, [{'url': 'file:///opt/stack/data/glance/images/88495831-0a2d-4e00-94a4-e0c09cf62505', 'metadata': {}}])) to volume 1fc9668d-bfbd-49d0-ad7f-28cc20fb883b successfully. {{(pid=86722) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Temporary image 88495831-0a2d-4e00-94a4-e0c09cf62505 for user 8c3bccf0010b485285ebb98649e4419e is deleted. {{(pid=86722) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.volume.volume_utils [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Marking volume 1fc9668d-bfbd-49d0-ad7f-28cc20fb883b as bootable. {{(pid=86722) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Copying metadata from image 88495831-0a2d-4e00-94a4-e0c09cf62505 to 1fc9668d-bfbd-49d0-ad7f-28cc20fb883b. {{(pid=86722) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Creating volume glance metadata for volume 1fc9668d-bfbd-49d0-ad7f-28cc20fb883b backed by image 88495831-0a2d-4e00-94a4-e0c09cf62505 with: {'image_id': '88495831-0a2d-4e00-94a4-e0c09cf62505', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ff99816ea72c7da3902de5ef5817c49f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86722) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76caf1f2-e5a3-49ca-9566-2d08d1623139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b', 'volume_size': 1, 'image_id': '88495831-0a2d-4e00-94a4-e0c09cf62505', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/88495831-0a2d-4e00-94a4-e0c09cf62505', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff99816ea72c7da3902de5ef5817c49f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17fa31993bce4e44ade8b9119b3499e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59df8de81fc18c1d199f0c3f49e9d443b835c71186256996bcf7a2d02a5ad89f149f032bbf3c3675a73c6c57ed0fae21a9eedac76ff564453607aa3b1a9b10a4', 'id': '88495831-0a2d-4e00-94a4-e0c09cf62505', 'created_at': datetime.datetime(2026, 6, 4, 11, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 4, 11, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/88495831-0a2d-4e00-94a4-e0c09cf62505/file', 'properties': {}}, 'image_service': }' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bfe33e-0faa-4a4c-9268-478a2d6d407a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:05 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Volume volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b (1fc9668d-bfbd-49d0-ad7f-28cc20fb883b): created successfully Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bfe33e-0faa-4a4c-9268-478a2d6d407a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Flow 'volume_create_manager' (4300b165-ba39-4916-a008-0248b593f457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:05 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-56cd7dd6-90fa-493b-9bf0-6d4e4dfdab7b tempest-VolumeImageDependencyTests-136033010 None] Created volume successfully. Jun 04 13:37:05 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1" returned: 0 in 0.620s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:05 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.info Jun 04 13:37:05 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Acquiring lock "cinder-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Lock "cinder-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Acquiring lock "cinder-quobyte-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:05 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Lock "cinder-quobyte-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b" acquired by "delete_volume" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:06 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a584d6-2390-44ee-aa13-8e6f821e029e]: (4, 'raw') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:06 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b Jun 04 13:37:06 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:06 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.info" returned: 0 in 0.632s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:06 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.info is being set with open permissions: ugo+rw Jun 04 13:37:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:06 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.info Jun 04 13:37:06 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:06 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b" returned: 0 in 0.733s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:06 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.info" returned: 0 in 0.606s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:06 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b Jun 04 13:37:06 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.466s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.068s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:06 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] Creating offline snapshot 69238434-6d14-4d94-b054-bec4f5b5d0df of volume e2061a90-2cc0-461b-9d6d-d13d1ef23b79 {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:37:06 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-311fbf40-35b2-49f0-af9b-b8143c967085 tempest-VolumeDependencyTests-1662757146 None] Create snapshot completed successfully Jun 04 13:37:06 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8796bfb-a38b-48c2-bcb2-ff95e5f12d14]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:06 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:07 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 Jun 04 13:37:07 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:07 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b" returned: 1 in 0.698s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b' failed. Not Retrying. {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:07 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b Jun 04 13:37:07 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:07 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79" returned: 0 in 0.842s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:37:07 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df 1G Jun 04 13:37:07 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Flow 'volume_create_manager' (cba90a3a-58d1-4280-8f7d-96d78eb50cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4baa09cc-de71-4401-ab56-944119d6f45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4baa09cc-de71-4401-ab56-944119d6f45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-928820997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac5c4d7-c860-4f1e-ab1e-e884f356f688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0982f21280a84032ae59e0a3f7a05437',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8da6de2-e474-487c-96e7-898541ce2ef1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:08Z,use_quota=True,user_id='b454e890ea0d4c6d94aa217dfa179e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2628344e-81e1-4a6f-89d9-9b9a481aaa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2628344e-81e1-4a6f-89d9-9b9a481aaa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39f2e80-b3f9-4648-93f3-0fe87eb8154f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c39f2e80-b3f9-4648-93f3-0fe87eb8154f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bac5c4d7-c860-4f1e-ab1e-e884f356f688', 'volume_name': 'volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688', 'volume_size': 1, 'snapshot_id': 'd8da6de2-e474-487c-96e7-898541ce2ef1'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b96192d-e6a1-4e40-91aa-a6f32f3f5d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b96192d-e6a1-4e40-91aa-a6f32f3f5d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dd42f8-32f8-4266-a242-b441a16676ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:07 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Volume bac5c4d7-c860-4f1e-ab1e-e884f356f688: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688', 'volume_size': 1, 'snapshot_id': 'd8da6de2-e474-487c-96e7-898541ce2ef1'} Jun 04 13:37:07 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:08 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b" returned: 0 in 0.702s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Lock "cinder-quobyte-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b" released by "delete_volume" :: held 2.205s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Created reservations ['21d14973-2144-4dec-84b8-a4be2ed7b6a4', '6d28d0e9-4b02-4636-a70b-02e3d60ac1db', 'd4741113-8dad-433b-ad7a-a469cb734ea0', '8454f4e1-3428-4cf7-b474-f1cd3632b7b1'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:08 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:08 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:08 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df 1G" returned: 0 in 0.892s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:08 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df Jun 04 13:37:08 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:08 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.716s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:08 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:09 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Deleted volume successfully. Jun 04 13:37:09 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-a5b80651-7039-4649-93b6-9f3d7b67cdbd tempest-VolumeImageDependencyTests-136033010 None] Lock "cinder-1fc9668d-bfbd-49d0-ad7f-28cc20fb883b-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:09 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df" returned: 0 in 0.670s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:09 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df is being set with open permissions: ugo+rw Jun 04 13:37:09 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:09 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df Jun 04 13:37:09 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:10 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df" returned: 0 in 0.740s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:10 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.info Jun 04 13:37:10 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:10 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.info" returned: 0 in 0.667s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:10 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.info is being set with open permissions: ugo+rw Jun 04 13:37:10 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:10 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.info Jun 04 13:37:10 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:11 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.info" returned: 0 in 0.657s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.595s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.554s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "cinder-quobyte-d8da6de2-e474-487c-96e7-898541ce2ef1-bac5c4d7-c860-4f1e-ab1e-e884f356f688" by "_create_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-quobyte-d8da6de2-e474-487c-96e7-898541ce2ef1-bac5c4d7-c860-4f1e-ab1e-e884f356f688" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Creating volume bac5c4d7-c860-4f1e-ab1e-e884f356f688 from snapshot d8da6de2-e474-487c-96e7-898541ce2ef1 {{(pid=86722) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "cinder-quobyte-bac5c4d7-c860-4f1e-ab1e-e884f356f688" by "_copy_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:11 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6949f782-f67f-488c-b11e-9d541b14c080 tempest-CreateVolumesFromSnapshotTest-60328812 None] Create snapshot completed successfully Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-quobyte-bac5c4d7-c860-4f1e-ab1e-e884f356f688" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] snapshot: d8da6de2-e474-487c-96e7-898541ce2ef1, volume: bac5c4d7-c860-4f1e-ab1e-e884f356f688, {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[0145b889-57ec-40ad-a417-9d1a76ccfc6a]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:11 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:11 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 Jun 04 13:37:11 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:12 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1" returned: 0 in 0.868s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f483995-49ff-4d6d-91e9-a1b44226338d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Creating direct copy from snapshot {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a598336-43fc-403b-b4c9-bf91e4fb66e7]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:12 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d Jun 04 13:37:12 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Flow 'volume_create_manager' (4a7e9a7a-0489-411b-8905-1fe80386fabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6947983-50b4-4221-b7ef-ced7eab2850e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6947983-50b4-4221-b7ef-ced7eab2850e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-708240637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37346e67-b0df-477e-a7ce-59f0cc14b934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16497c80d327476ba0208ecee77e2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:13Z,use_quota=True,user_id='a5aa2a70499549d3a0881d68e29c4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a95f90-b91e-43f0-a304-ecce9241bb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a95f90-b91e-43f0-a304-ecce9241bb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfb5684-babf-4954-b65d-7a4dac000b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfb5684-babf-4954-b65d-7a4dac000b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37346e67-b0df-477e-a7ce-59f0cc14b934', 'volume_name': 'volume-37346e67-b0df-477e-a7ce-59f0cc14b934', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd647fe7-4a7f-4cba-96a0-80b6a72669a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd647fe7-4a7f-4cba-96a0-80b6a72669a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da5b547-a1d3-4c95-883e-b8b076e579b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:12 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume 37346e67-b0df-477e-a7ce-59f0cc14b934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37346e67-b0df-477e-a7ce-59f0cc14b934', 'volume_size': 1} Jun 04 13:37:12 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Flow 'volume_create_manager' (5794d77c-d039-46db-ad1e-eb4ba1ceee74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db611f61-b596-4843-81c6-9f9a9e1f30e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db611f61-b596-4843-81c6-9f9a9e1f30e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-274548524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16497c80d327476ba0208ecee77e2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:13Z,use_quota=True,user_id='a5aa2a70499549d3a0881d68e29c4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ac079c-6e05-475b-bdf8-074b3df8ca11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ac079c-6e05-475b-bdf8-074b3df8ca11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763f4f61-f663-4c99-8a41-5cba095a2a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763f4f61-f663-4c99-8a41-5cba095a2a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33', 'volume_name': 'volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0b1fee-dcc9-4283-a2a9-9c8dd7c6576a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0b1fee-dcc9-4283-a2a9-9c8dd7c6576a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845eec64-e152-4321-acd8-e5b655badeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:13 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume 54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33', 'volume_size': 1} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:13 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d" returned: 0 in 0.926s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.utils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Path /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688 not found in is_blk_device check {{(pid=86722) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:13 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688 Jun 04 13:37:13 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Flow 'volume_create_manager' (3c912dff-b12b-4d23-89b2-5078e8091862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465cab3b-d80e-41d2-b950-49506d999562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465cab3b-d80e-41d2-b950-49506d999562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1976179771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16497c80d327476ba0208ecee77e2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:14Z,use_quota=True,user_id='a5aa2a70499549d3a0881d68e29c4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f944ec31-656d-4d8f-8649-e67b25fda794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f944ec31-656d-4d8f-8649-e67b25fda794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab2dd1f-c744-4ddd-9a61-5ca9914d2b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab2dd1f-c744-4ddd-9a61-5ca9914d2b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29', 'volume_name': 'volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e67ed3-f8aa-42bb-ac3e-5f70de363e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e67ed3-f8aa-42bb-ac3e-5f70de363e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984251d0-86d5-4a60-9fd8-17b99a500026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:13 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29', 'volume_size': 1} Jun 04 13:37:13 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Flow 'volume_create_manager' (ebcbdf53-9f57-4da7-ab41-ee8eb3488159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39bfe5f-04c9-4543-bc51-9eb5947c434a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39bfe5f-04c9-4543-bc51-9eb5947c434a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2126098341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6748ed79-8422-4d34-b799-40c2756a6028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16497c80d327476ba0208ecee77e2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:14Z,use_quota=True,user_id='a5aa2a70499549d3a0881d68e29c4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06aaf400-f5da-4844-bcc0-d1b415842f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06aaf400-f5da-4844-bcc0-d1b415842f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d856cb1-c51f-45c6-947e-3b9bcdda2b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d856cb1-c51f-45c6-947e-3b9bcdda2b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6748ed79-8422-4d34-b799-40c2756a6028', 'volume_name': 'volume-6748ed79-8422-4d34-b799-40c2756a6028', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60716561-a11d-4a90-8804-c2af151b0fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60716561-a11d-4a90-8804-c2af151b0fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33fde3fd-3ee4-419f-9b6a-2d5006ad66b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:14 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume 6748ed79-8422-4d34-b799-40c2756a6028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6748ed79-8422-4d34-b799-40c2756a6028', 'volume_size': 1} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Flow 'volume_create_manager' (5aeb25a2-230a-4d12-a5e9-ea58452857df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9015b24e-0dc8-4397-aac4-44a6623aa21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9015b24e-0dc8-4397-aac4-44a6623aa21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-289683726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae934e08-cdf5-4a27-be45-aefc38b1cf5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16497c80d327476ba0208ecee77e2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:14Z,use_quota=True,user_id='a5aa2a70499549d3a0881d68e29c4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f531624-0555-4466-897a-9d814248ffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f531624-0555-4466-897a-9d814248ffed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e0733f-4a52-416c-86cf-ae11b4d47ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e0733f-4a52-416c-86cf-ae11b4d47ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae934e08-cdf5-4a27-be45-aefc38b1cf5a', 'volume_name': 'volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b68ab1e-f59a-4d38-81b5-2ca997e9f851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b68ab1e-f59a-4d38-81b5-2ca997e9f851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407e7ca6-0915-4c8b-8579-e7d1058a5db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:14 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume ae934e08-cdf5-4a27-be45-aefc38b1cf5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a', 'volume_size': 1} Jun 04 13:37:14 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:19 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688" returned: 0 in 5.605s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:19 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3415db-5edc-4c60-998e-963686728cdb]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:19 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d Jun 04 13:37:19 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:19 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d" returned: 0 in 0.901s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:19 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688 {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:37:19 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Converted 1024.00 MB image at 182.66 MB/s Jun 04 13:37:19 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688 is being set with open permissions: ugo+rw Jun 04 13:37:19 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:19 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688 Jun 04 13:37:19 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:20 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688" returned: 0 in 0.597s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-quobyte-bac5c4d7-c860-4f1e-ab1e-e884f356f688" released by "_copy_volume_from_snapshot" :: held 9.037s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-quobyte-d8da6de2-e474-487c-96e7-898541ce2ef1-bac5c4d7-c860-4f1e-ab1e-e884f356f688" released by "_create_volume_from_snapshot" :: held 9.084s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.120s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.704s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-708240637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37346e67-b0df-477e-a7ce-59f0cc14b934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16497c80d327476ba0208ecee77e2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:13Z,use_quota=True,user_id='a5aa2a70499549d3a0881d68e29c4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Creating volume 37346e67-b0df-477e-a7ce-59f0cc14b934 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:37:20 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-37346e67-b0df-477e-a7ce-59f0cc14b934 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:SELECT=148,cinder:UPDATE=193,cinder:DELETE=18,cinder:INSERT=54 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:37:20 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-37346e67-b0df-477e-a7ce-59f0cc14b934 1073741824 Jun 04 13:37:20 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=183,cinder:SELECT=141,cinder:INSERT=49,cinder:DELETE=17 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dd42f8-32f8-4266-a242-b441a16676ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688', 'volume_size': 1, 'snapshot_id': 'd8da6de2-e474-487c-96e7-898541ce2ef1'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1671458d-93d2-46fb-aa31-7370eedcf1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:20 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Volume volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688 (bac5c4d7-c860-4f1e-ab1e-e884f356f688): created successfully Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1671458d-93d2-46fb-aa31-7370eedcf1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Flow 'volume_create_manager' (cba90a3a-58d1-4280-8f7d-96d78eb50cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:20 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-7771ed2d-7bb3-4091-83e2-f0c13aa35fad tempest-VolumeDependencyTests-1662757146 None] Created volume successfully. Jun 04 13:37:20 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "cinder-d8da6de2-e474-487c-96e7-898541ce2ef1-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-d8da6de2-e474-487c-96e7-898541ce2ef1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "cinder-quobyte-8f483995-49ff-4d6d-91e9-a1b44226338d" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-quobyte-8f483995-49ff-4d6d-91e9-a1b44226338d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "cinder-quobyte-d8da6de2-e474-487c-96e7-898541ce2ef1" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-quobyte-d8da6de2-e474-487c-96e7-898541ce2ef1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Deleting offline snapshot d8da6de2-e474-487c-96e7-898541ce2ef1 of volume 8f483995-49ff-4d6d-91e9-a1b44226338d {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] snapshot_file for this snap is: volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[915a7678-2f6f-4253-bb9c-b09a69ac5e4e]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:21 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 Jun 04 13:37:21 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:21 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-37346e67-b0df-477e-a7ce-59f0cc14b934 1073741824" returned: 0 in 0.851s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-37346e67-b0df-477e-a7ce-59f0cc14b934 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:21 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-37346e67-b0df-477e-a7ce-59f0cc14b934 Jun 04 13:37:21 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:21 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1" returned: 0 in 0.738s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f483995-49ff-4d6d-91e9-a1b44226338d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71497d6-206c-4351-8eb7-f3d3f22b062b]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:21 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:21 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d Jun 04 13:37:21 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:22 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-37346e67-b0df-477e-a7ce-59f0cc14b934" returned: 0 in 0.630s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.868s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-274548524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16497c80d327476ba0208ecee77e2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:13Z,use_quota=True,user_id='a5aa2a70499549d3a0881d68e29c4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Creating volume 54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:37:22 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:22 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33 1073741824 Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da5b547-a1d3-4c95-883e-b8b076e579b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37346e67-b0df-477e-a7ce-59f0cc14b934', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:22 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2deb18a2-c0e2-48b5-97bd-f9afd750af40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:22 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume volume-37346e67-b0df-477e-a7ce-59f0cc14b934 (37346e67-b0df-477e-a7ce-59f0cc14b934): created successfully Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2deb18a2-c0e2-48b5-97bd-f9afd750af40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Flow 'volume_create_manager' (4a7e9a7a-0489-411b-8905-1fe80386fabe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:22 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f9b313d8-815c-402a-abbf-f542c4f533c6 tempest-CreateVolumesFromSnapshotTest-60328812 None] Created volume successfully. Jun 04 13:37:22 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d" returned: 0 in 0.887s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:22 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:22 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 Jun 04 13:37:22 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:23 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33 1073741824" returned: 0 in 1.024s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:23 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33 Jun 04 13:37:23 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:23 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1" returned: 0 in 0.767s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:23 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1 Jun 04 13:37:23 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:23 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33" returned: 0 in 0.662s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.172s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1976179771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16497c80d327476ba0208ecee77e2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:14Z,use_quota=True,user_id='a5aa2a70499549d3a0881d68e29c4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Creating volume a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:37:23 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:23 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29 1073741824 Jun 04 13:37:23 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845eec64-e152-4321-acd8-e5b655badeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6977d67a-31b6-4d32-b1dd-514045a0d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:23 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33 (54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33): created successfully Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6977d67a-31b6-4d32-b1dd-514045a0d316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:23 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Flow 'volume_create_manager' (5794d77c-d039-46db-ad1e-eb4ba1ceee74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:24 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-cb821200-451d-437f-b610-2a7deed00e32 tempest-CreateVolumesFromSnapshotTest-60328812 None] Created volume successfully. Jun 04 13:37:24 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d.d8da6de2-e474-487c-96e7-898541ce2ef1" returned: 0 in 0.701s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-quobyte-d8da6de2-e474-487c-96e7-898541ce2ef1" released by "_delete_snapshot" :: held 3.238s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-quobyte-8f483995-49ff-4d6d-91e9-a1b44226338d" released by "delete_snapshot" :: held 3.275s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:24 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Created reservations ['208045fa-8b93-4a0e-98af-a3734efdbf13', '71d09317-65cb-4c3e-8cd8-8b9489f30600', '6f1eb055-2912-44d5-8062-2230b4a26e83', '92b91d58-e0bc-497e-88d1-87c6337d67bc'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:24 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Delete snapshot completed successfully. Jun 04 13:37:24 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-127be1ec-54eb-4088-a5b6-dba7771ec6d5 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-d8da6de2-e474-487c-96e7-898541ce2ef1-delete_snapshot" released by "delete_snapshot" :: held 3.461s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:24 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29 1073741824" returned: 0 in 0.946s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:24 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:24 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29 Jun 04 13:37:24 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "cinder-8f483995-49ff-4d6d-91e9-a1b44226338d-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-8f483995-49ff-4d6d-91e9-a1b44226338d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "cinder-quobyte-8f483995-49ff-4d6d-91e9-a1b44226338d" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-quobyte-8f483995-49ff-4d6d-91e9-a1b44226338d" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d83e8ba-e612-4ab8-ad33-e52dbd4eeb29]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:25 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29" returned: 0 in 0.687s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.395s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2126098341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6748ed79-8422-4d34-b799-40c2756a6028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16497c80d327476ba0208ecee77e2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:14Z,use_quota=True,user_id='a5aa2a70499549d3a0881d68e29c4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Creating volume 6748ed79-8422-4d34-b799-40c2756a6028 {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:37:25 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6748ed79-8422-4d34-b799-40c2756a6028 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984251d0-86d5-4a60-9fd8-17b99a500026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac977d3a-094b-40b7-97b4-31163ba20f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:25 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6748ed79-8422-4d34-b799-40c2756a6028 1073741824 Jun 04 13:37:25 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:25 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29 (a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29): created successfully Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac977d3a-094b-40b7-97b4-31163ba20f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:25 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Flow 'volume_create_manager' (3c912dff-b12b-4d23-89b2-5078e8091862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:25 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d Jun 04 13:37:25 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:25 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-b58fac3f-ef2e-486d-8e9d-f16c346ade74 tempest-CreateVolumesFromSnapshotTest-60328812 None] Created volume successfully. Jun 04 13:37:26 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d" returned: 0 in 0.790s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:26 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d Jun 04 13:37:26 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:26 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6748ed79-8422-4d34-b799-40c2756a6028 1073741824" returned: 0 in 0.829s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:26 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6748ed79-8422-4d34-b799-40c2756a6028 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:26 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6748ed79-8422-4d34-b799-40c2756a6028 Jun 04 13:37:26 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:27 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-8f483995-49ff-4d6d-91e9-a1b44226338d" returned: 0 in 0.713s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-quobyte-8f483995-49ff-4d6d-91e9-a1b44226338d" released by "delete_volume" :: held 1.606s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Created reservations ['c07568ed-1800-45e6-8b41-41dcb668b62d', '0c92f6ba-5a61-4860-8421-e861907b2866', '071af00a-f1a5-44f1-9258-9d1e13c66d1b', 'ff8aa63f-a613-4489-a129-57051bb77bd3'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:27 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6748ed79-8422-4d34-b799-40c2756a6028" returned: 0 in 0.685s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.503s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-289683726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae934e08-cdf5-4a27-be45-aefc38b1cf5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16497c80d327476ba0208ecee77e2918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:14Z,use_quota=True,user_id='a5aa2a70499549d3a0881d68e29c4c09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Creating volume ae934e08-cdf5-4a27-be45-aefc38b1cf5a {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:37:27 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:27 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a 1073741824 Jun 04 13:37:27 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33fde3fd-3ee4-419f-9b6a-2d5006ad66b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6748ed79-8422-4d34-b799-40c2756a6028', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7b08bf-db53-484f-bc65-a0a297d0dbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:27 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume volume-6748ed79-8422-4d34-b799-40c2756a6028 (6748ed79-8422-4d34-b799-40c2756a6028): created successfully Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7b08bf-db53-484f-bc65-a0a297d0dbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Flow 'volume_create_manager' (ebcbdf53-9f57-4da7-ab41-ee8eb3488159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:27 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f6c02365-a005-4709-ac94-065b28c4f69c tempest-CreateVolumesFromSnapshotTest-60328812 None] Created volume successfully. Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:27 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:27 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "cinder-bac5c4d7-c860-4f1e-ab1e-e884f356f688-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-bac5c4d7-c860-4f1e-ab1e-e884f356f688-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "cinder-quobyte-bac5c4d7-c860-4f1e-ab1e-e884f356f688" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-quobyte-bac5c4d7-c860-4f1e-ab1e-e884f356f688" acquired by "delete_volume" :: waited 0.023s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a4fb81-f761-4ddb-ac4b-b841b55a07ee]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:27 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:28 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688 Jun 04 13:37:28 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:28 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.813s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:28 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Deleted volume successfully. Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-24701298-9423-4529-9d7e-bf961d8ddc97 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-8f483995-49ff-4d6d-91e9-a1b44226338d-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:28 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a 1073741824" returned: 0 in 0.999s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:28 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a Jun 04 13:37:28 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:28 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688" returned: 0 in 0.962s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:28 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688 Jun 04 13:37:28 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:28 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a" returned: 0 in 0.704s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407e7ca6-0915-4c8b-8579-e7d1058a5db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52181738-83e5-45e0-baab-1c81f33ad7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:28 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Volume volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a (ae934e08-cdf5-4a27-be45-aefc38b1cf5a): created successfully Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52181738-83e5-45e0-baab-1c81f33ad7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:28 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Flow 'volume_create_manager' (5aeb25a2-230a-4d12-a5e9-ea58452857df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:29 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c49422ff-f27c-40c7-b7f2-5897f2a04634 tempest-CreateVolumesFromSnapshotTest-60328812 None] Created volume successfully. Jun 04 13:37:29 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-bac5c4d7-c860-4f1e-ab1e-e884f356f688" returned: 0 in 0.634s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-quobyte-bac5c4d7-c860-4f1e-ab1e-e884f356f688" released by "delete_volume" :: held 1.646s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Flow 'volume_create_manager' (6a7ad5c3-e2d7-4dad-850b-e67f08c0ca41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5907d2b0-3272-4761-a499-186a71af3c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5907d2b0-3272-4761-a499-186a71af3c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1009078401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36d35ec-e44a-4897-afba-617ee36f844f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5546b7eed9464065888cc56607396d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:29Z,use_quota=True,user_id='c176c76da10d4ab9aeda42dda1e05d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec034d0e-f3be-423d-98b5-25587c05b296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec034d0e-f3be-423d-98b5-25587c05b296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3685d4-c533-4182-858a-5d6757a81213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3685d4-c533-4182-858a-5d6757a81213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c36d35ec-e44a-4897-afba-617ee36f844f', 'volume_name': 'volume-c36d35ec-e44a-4897-afba-617ee36f844f', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d90ecb-de42-4d42-8d9b-8d5521a3e955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1d90ecb-de42-4d42-8d9b-8d5521a3e955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72e89da-2fca-4569-93ab-addff933cc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:29 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Volume c36d35ec-e44a-4897-afba-617ee36f844f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c36d35ec-e44a-4897-afba-617ee36f844f', 'volume_size': 1} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1009078401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36d35ec-e44a-4897-afba-617ee36f844f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5546b7eed9464065888cc56607396d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:29Z,use_quota=True,user_id='c176c76da10d4ab9aeda42dda1e05d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)}" {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Creating volume c36d35ec-e44a-4897-afba-617ee36f844f {{(pid=86722) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:37:29 devstack cinder-volume[86722]: INFO cinder.volume.drivers.remotefs [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] casted to osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f 1073741824 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Created reservations ['7eb32eb2-d58a-4b26-82e4-2368b5f62e9c', 'de4e36ba-ff75-4e2a-a23e-37908cbafcd2', 'b6b7e48a-31a1-46de-ba7f-21bf800ce82f', '919d2a0c-ba6d-4f46-a731-5b7896d6c890'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:29 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f 1073741824 Jun 04 13:37:29 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:29 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:29 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:29 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:30 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-ae934e08-cdf5-4a27-be45-aefc38b1cf5a-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:30 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-ae934e08-cdf5-4a27-be45-aefc38b1cf5a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:30 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-quobyte-ae934e08-cdf5-4a27-be45-aefc38b1cf5a" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:30 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-ae934e08-cdf5-4a27-be45-aefc38b1cf5a" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:30 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:30 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a584dd-0900-43c5-bc3d-d3f7c0b10fff]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.681s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:30 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:30 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Deleted volume successfully. Jun 04 13:37:30 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-05fb8251-c3b0-40cb-ab15-6ac025145bf7 tempest-VolumeDependencyTests-1662757146 None] Lock "cinder-bac5c4d7-c860-4f1e-ab1e-e884f356f688-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:30 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a Jun 04 13:37:30 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:30 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f 1073741824" returned: 0 in 0.908s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:30 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:30 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f Jun 04 13:37:30 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:31 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a" returned: 0 in 0.785s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:31 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a Jun 04 13:37:31 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:31 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f" returned: 0 in 0.656s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'} {{(pid=86722) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72e89da-2fca-4569-93ab-addff933cc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c36d35ec-e44a-4897-afba-617ee36f844f', 'volume_size': 1}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a254e0-9488-4842-9ffa-44f85123e5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:31 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Volume volume-c36d35ec-e44a-4897-afba-617ee36f844f (c36d35ec-e44a-4897-afba-617ee36f844f): created successfully Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a254e0-9488-4842-9ffa-44f85123e5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Flow 'volume_create_manager' (6a7ad5c3-e2d7-4dad-850b-e67f08c0ca41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:31 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-98573254-9972-43a6-803f-a497f591729b tempest-SnapshotDependencyTests-2119082495 None] Created volume successfully. Jun 04 13:37:31 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-ae934e08-cdf5-4a27-be45-aefc38b1cf5a" returned: 0 in 0.661s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-ae934e08-cdf5-4a27-be45-aefc38b1cf5a" released by "delete_volume" :: held 1.498s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Created reservations ['f54a320e-f16e-4334-8954-5f32eb36f945', 'c91ebaed-2b3a-4563-a98e-d2c0e80789c1', '81387ec1-f57f-49e0-aba3-114cf121bbb5', 'ba2bf9cf-114a-4d7a-a8a3-018476f5bd49'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] Creating offline snapshot cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc of volume c36d35ec-e44a-4897-afba-617ee36f844f {{(pid=86722) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfe058d-0a15-4a89-9ace-2ede7d70bab7]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:31 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:32 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:32 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:32 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f Jun 04 13:37:32 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:32 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-6748ed79-8422-4d34-b799-40c2756a6028-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:32 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-6748ed79-8422-4d34-b799-40c2756a6028-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:32 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-quobyte-6748ed79-8422-4d34-b799-40c2756a6028" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:32 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-6748ed79-8422-4d34-b799-40c2756a6028" acquired by "delete_volume" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:32 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[5647ba92-419a-4547-abcd-a794d5fa73e9]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6748ed79-8422-4d34-b799-40c2756a6028 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:32 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.636s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:32 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:32 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Deleted volume successfully. Jun 04 13:37:32 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ebb9f353-bea0-420d-8951-62db0106ad0e tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-ae934e08-cdf5-4a27-be45-aefc38b1cf5a-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:32 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6748ed79-8422-4d34-b799-40c2756a6028 Jun 04 13:37:32 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:32 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f" returned: 0 in 0.768s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:32 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc 1G {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:32 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc 1G Jun 04 13:37:32 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:33 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6748ed79-8422-4d34-b799-40c2756a6028" returned: 0 in 0.748s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6748ed79-8422-4d34-b799-40c2756a6028 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:33 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6748ed79-8422-4d34-b799-40c2756a6028 Jun 04 13:37:33 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:33 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc 1G" returned: 0 in 0.802s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36d35ec-e44a-4897-afba-617ee36f844f -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:33 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36d35ec-e44a-4897-afba-617ee36f844f -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc Jun 04 13:37:33 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:33 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:33 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-6748ed79-8422-4d34-b799-40c2756a6028" returned: 0 in 0.626s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:33 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-6748ed79-8422-4d34-b799-40c2756a6028" released by "delete_volume" :: held 1.424s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Created reservations ['e22ecaf1-09cc-4b6c-b5c7-913d0d6f3edc', '4ef3965c-7edc-4b8a-985e-8db39f934803', '71e46e3d-6d39-47e2-b89d-dd691f53673b', 'd85c69f3-267b-42d0-a507-f59efb41b40b'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:34 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:34 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:34 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36d35ec-e44a-4897-afba-617ee36f844f -F qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc" returned: 0 in 0.685s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:34 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc is being set with open permissions: ugo+rw Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:34 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc Jun 04 13:37:34 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:34 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.611s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:34 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Deleted volume successfully. Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-ceaee824-9891-4f5e-a9c8-7bbd8df2368f tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-6748ed79-8422-4d34-b799-40c2756a6028-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-quobyte-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29" acquired by "delete_volume" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce20aa2f-d052-4c24-92b5-33fa4bcb1b92]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:34 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc" returned: 0 in 0.665s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:34 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:34 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29 Jun 04 13:37:34 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:34 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.info Jun 04 13:37:34 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:35 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.info" returned: 0 in 0.604s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:35 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.info is being set with open permissions: ugo+rw Jun 04 13:37:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.info {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:35 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.info Jun 04 13:37:35 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:35 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29" returned: 0 in 0.732s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:35 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:35 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29 Jun 04 13:37:35 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:36 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.info" returned: 0 in 0.605s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.225s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:36 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29" returned: 0 in 0.597s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29" released by "delete_volume" :: held 1.375s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:36 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-c0a32dcd-072e-4b9e-ac27-272a1d006ac2 tempest-SnapshotDependencyTests-2119082495 None] Create snapshot completed successfully Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Created reservations ['e7101905-b4e2-4ecf-b30e-30cc71652d5c', '6516fa98-d303-4055-b246-91de1f8ecbac', '36170b86-8a7f-4273-a70d-0c316092d7b0', '8893782d-128f-4f4c-ace0-20a417cbee81'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:36 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:36 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:36 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.604s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:36 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Deleted volume successfully. Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-bf5ec3b0-bb6a-4fcc-aac7-a1d87ad3435f tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-a6dfbb29-24d0-4b6c-8f96-5b66c3ad7c29-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:36 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-quobyte-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33" acquired by "delete_volume" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[334a3d53-e82b-476b-9e1c-eabf954a27b0]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:37 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33 Jun 04 13:37:37 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.flows.manager.create_volume [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86722) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Flow 'volume_create_manager' (f18fc550-5370-40fb-becb-1839b73bceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2043fa2-47dc-4f04-ab4c-ab0141610f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2043fa2-47dc-4f04-ab4c-ab0141610f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-04T11:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54def48e-30fe-4ed5-ba7e-306f2ca6d8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5546b7eed9464065888cc56607396d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-04T11:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-04T11:37:38Z,use_quota=True,user_id='c176c76da10d4ab9aeda42dda1e05d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce86c596-dc69-40f0-bea0-febb2d503ef8),volume_type_id=ce86c596-dc69-40f0-bea0-febb2d503ef8)' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9def6068-0343-4f6f-833f-5d630743ea67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9def6068-0343-4f6f-833f-5d630743ea67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572ff40a-1061-473d-a66c-90a1911c2960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572ff40a-1061-473d-a66c-90a1911c2960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '54def48e-30fe-4ed5-ba7e-306f2ca6d8ba', 'volume_name': 'volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba', 'volume_size': 1, 'snapshot_id': 'cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426a1e7e-3c1c-4f38-86f9-58c1fbe5cfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426a1e7e-3c1c-4f38-86f9-58c1fbe5cfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a6076b-7c0d-4aea-8cf0-9871fb0725bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:37 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Volume 54def48e-30fe-4ed5-ba7e-306f2ca6d8ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba', 'volume_size': 1, 'snapshot_id': 'cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc'} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "cinder-quobyte-cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" by "_create_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:37 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33" returned: 0 in 0.715s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-quobyte-cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Creating volume 54def48e-30fe-4ed5-ba7e-306f2ca6d8ba from snapshot cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc {{(pid=86722) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Selected osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076 as target Quobyte volume. {{(pid=86722) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "cinder-quobyte-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" by "_copy_volume_from_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-quobyte-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] snapshot: cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc, volume: 54def48e-30fe-4ed5-ba7e-306f2ca6d8ba, {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3e7580-6354-483f-acfd-221001ab81fe]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:37 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33 Jun 04 13:37:37 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:37 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:37 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc Jun 04 13:37:37 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:38 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33" returned: 0 in 0.654s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33" released by "delete_volume" :: held 1.412s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Created reservations ['6f5c14af-3c60-4353-9181-b92ca9cc3201', 'ee389fe8-7ee0-441a-bf2d-ed2428bd2763', '0b8bf9c5-2fe8-43a6-be0e-1ab8b61ec838', '34e10419-b305-4cd7-a2f2-0a3210b73629'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:38 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:38 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:38 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc" returned: 0 in 0.739s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c36d35ec-e44a-4897-afba-617ee36f844f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Creating direct copy from snapshot {{(pid=86722) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd59524-655d-4100-9e19-b0f8db042c73]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:38 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:38 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f Jun 04 13:37:38 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:39 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.606s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-37346e67-b0df-477e-a7ce-59f0cc14b934-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:39 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Deleted volume successfully. Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-37346e67-b0df-477e-a7ce-59f0cc14b934-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4ca1b770-8c75-4b4a-b055-2280d38ec30d tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-54a2e4dc-ec7d-407b-9f9e-bc0c7a4c0e33-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-quobyte-37346e67-b0df-477e-a7ce-59f0cc14b934" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-37346e67-b0df-477e-a7ce-59f0cc14b934" acquired by "delete_volume" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[797596a0-daab-4ce4-8fed-2ab545219c76]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-37346e67-b0df-477e-a7ce-59f0cc14b934 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:39 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f" returned: 0 in 0.737s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG cinder.utils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Path /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba not found in is_blk_device check {{(pid=86722) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:39 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-37346e67-b0df-477e-a7ce-59f0cc14b934 Jun 04 13:37:39 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:39 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba Jun 04 13:37:39 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:39 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-37346e67-b0df-477e-a7ce-59f0cc14b934" returned: 0 in 0.703s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:39 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-37346e67-b0df-477e-a7ce-59f0cc14b934 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:40 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-37346e67-b0df-477e-a7ce-59f0cc14b934 Jun 04 13:37:40 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:42 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-37346e67-b0df-477e-a7ce-59f0cc14b934" returned: 0 in 2.159s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-37346e67-b0df-477e-a7ce-59f0cc14b934" released by "delete_volume" :: held 2.926s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Created reservations ['f36d244c-dfa1-42cc-8e47-0eb95d3cad73', 'b1063ff6-f941-4ff3-9c75-47677c533139', '310a5587-eee5-4a0d-9f21-1b8fa7293636', '2472c43e-7df9-413c-8f38-779117ca850b'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:42 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:42 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-69238434-6d14-4d94-b054-bec4f5b5d0df-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-69238434-6d14-4d94-b054-bec4f5b5d0df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-quobyte-e2061a90-2cc0-461b-9d6d-d13d1ef23b79" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-e2061a90-2cc0-461b-9d6d-d13d1ef23b79" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-quobyte-69238434-6d14-4d94-b054-bec4f5b5d0df" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-69238434-6d14-4d94-b054-bec4f5b5d0df" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:42 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Deleting offline snapshot 69238434-6d14-4d94-b054-bec4f5b5d0df of volume e2061a90-2cc0-461b-9d6d-d13d1ef23b79 {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:37:43 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] snapshot_file for this snap is: volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:37:43 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4222762-b6b7-44d1-92a1-81920f513639]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:43 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:43 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df Jun 04 13:37:43 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:44 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 1.563s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:44 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:44 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Deleted volume successfully. Jun 04 13:37:44 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-d25a5633-0a4e-4cdb-811e-5b02e6a31670 tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-37346e67-b0df-477e-a7ce-59f0cc14b934-delete_volume" released by "delete_volume" :: held 4.957s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:44 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" returned: 0 in 5.050s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:44 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a17a6e-b58e-43a2-8297-147224cfe6cd]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:44 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f Jun 04 13:37:44 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:44 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df" returned: 0 in 1.527s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:44 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:37:44 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[6140902c-c218-4049-b4f7-16b9d8500fcb]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:44 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:44 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 Jun 04 13:37:44 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:45 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f" returned: 0 in 0.866s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG cinder.image.image_utils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Image conversion details: src /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba {{(pid=86722) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 04 13:37:45 devstack cinder-volume[86722]: INFO cinder.image.image_utils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Converted 1024.00 MB image at 202.74 MB/s Jun 04 13:37:45 devstack cinder-volume[86722]: WARNING cinder.volume.drivers.remotefs [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba is being set with open permissions: ugo+rw Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:45 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79" returned: 0 in 0.688s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:45 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba Jun 04 13:37:45 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:45 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df Jun 04 13:37:45 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:45 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" returned: 0 in 0.609s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-quobyte-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" released by "_copy_volume_from_snapshot" :: held 8.120s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-quobyte-cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" released by "_create_volume_from_snapshot" :: held 8.161s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.191s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a6076b-7c0d-4aea-8cf0-9871fb0725bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba', 'volume_size': 1, 'snapshot_id': 'cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc'}' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b849cb3a-018f-4351-b767-478186939b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 04 13:37:45 devstack cinder-volume[86722]: INFO cinder.volume.flows.manager.create_volume [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Volume volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba (54def48e-30fe-4ed5-ba7e-306f2ca6d8ba): created successfully Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b849cb3a-018f-4351-b767-478186939b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86722) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 04 13:37:45 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Flow 'volume_create_manager' (f18fc550-5370-40fb-becb-1839b73bceed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86722) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 04 13:37:46 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-054f1875-6480-4f3e-a87d-0dd9ad26d51a tempest-SnapshotDependencyTests-2119082495 None] Created volume successfully. Jun 04 13:37:46 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df" returned: 0 in 0.705s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:46 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df Jun 04 13:37:46 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "cinder-cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc-delete_snapshot" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "cinder-quobyte-c36d35ec-e44a-4897-afba-617ee36f844f" by "delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-quobyte-c36d35ec-e44a-4897-afba-617ee36f844f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "cinder-quobyte-cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc" by "_delete_snapshot" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-quobyte-cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:46 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Deleting offline snapshot cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc of volume c36d35ec-e44a-4897-afba-617ee36f844f {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] snapshot_file for this snap is: volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc {{(pid=86722) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79.69238434-6d14-4d94-b054-bec4f5b5d0df" returned: 0 in 0.605s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd32e4c-73f3-4d69-a15b-cf47a5a62291]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-69238434-6d14-4d94-b054-bec4f5b5d0df" released by "_delete_snapshot" :: held 3.724s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-e2061a90-2cc0-461b-9d6d-d13d1ef23b79" released by "delete_snapshot" :: held 3.777s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Created reservations ['92710c65-4104-4acf-8ab6-29028fceb90f', '801ef861-07e0-4119-ac1d-e00c9937cc24', '1793317d-961d-4cf0-b6e4-9b46829dbb65', '30cb3bd5-7791-48cb-b221-3b19b87b09e8'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:46 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc Jun 04 13:37:46 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:46 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Delete snapshot completed successfully. Jun 04 13:37:46 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-f7904654-1148-43de-b4b4-7138470ee28d tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-69238434-6d14-4d94-b054-bec4f5b5d0df-delete_snapshot" released by "delete_snapshot" :: held 3.927s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-e2061a90-2cc0-461b-9d6d-d13d1ef23b79-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-e2061a90-2cc0-461b-9d6d-d13d1ef23b79-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "cinder-quobyte-e2061a90-2cc0-461b-9d6d-d13d1ef23b79" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:47 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-e2061a90-2cc0-461b-9d6d-d13d1ef23b79" acquired by "delete_volume" :: waited 0.020s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:47 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5af0002-7df8-48a9-8ec3-b494c189f4cd]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:47 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 Jun 04 13:37:47 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:47 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc" returned: 0 in 0.689s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:47 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.remotefs [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c36d35ec-e44a-4897-afba-617ee36f844f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86722) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 04 13:37:47 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d7e31a-2a7c-4199-bc03-f55ec901e4a5]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:47 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f Jun 04 13:37:47 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:47 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79" returned: 0 in 0.715s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:47 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:47 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79 Jun 04 13:37:47 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:48 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f" returned: 0 in 0.710s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:48 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc Jun 04 13:37:48 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:48 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-e2061a90-2cc0-461b-9d6d-d13d1ef23b79" returned: 0 in 0.586s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-quobyte-e2061a90-2cc0-461b-9d6d-d13d1ef23b79" released by "delete_volume" :: held 1.363s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Created reservations ['7e8be432-c8f1-44ab-8f3c-a3afabd5a718', '8788f5bc-8136-4aa6-84cd-524c16082857', 'c8794538-14c9-4e76-9601-fd8767e20f1e', '4fed3c34-5baf-4649-9c11-0147781aa5fa'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:48 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:48 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:48 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc" returned: 0 in 0.720s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:48 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:48 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc Jun 04 13:37:48 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:49 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.604s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:49 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Deleted volume successfully. Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-6ce3ec0a-5ec0-4cee-b8d2-4924ea19e45a tempest-CreateVolumesFromSnapshotTest-60328812 None] Lock "cinder-e2061a90-2cc0-461b-9d6d-d13d1ef23b79-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:49 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f.cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc" returned: 0 in 0.578s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-quobyte-cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc" released by "_delete_snapshot" :: held 2.797s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-quobyte-c36d35ec-e44a-4897-afba-617ee36f844f" released by "delete_snapshot" :: held 2.821s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Created reservations ['e6a36ec7-bbe5-40da-8faf-8b65144770d1', '3b19e953-e4c0-4b04-99d6-c8c0e005a133', 'fae2d049-fdaf-4164-a123-a28b6695bff2', '95f24fb8-5205-4078-9993-42174574f921'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:49 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Delete snapshot completed successfully. Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-fa44186e-97ea-4503-b3cd-33d9ae80041b tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-cf0165c8-e201-4f3d-9e4f-9b2fcd79a7dc-delete_snapshot" released by "delete_snapshot" :: held 2.964s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "cinder-c36d35ec-e44a-4897-afba-617ee36f844f-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-c36d35ec-e44a-4897-afba-617ee36f844f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "cinder-quobyte-c36d35ec-e44a-4897-afba-617ee36f844f" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-quobyte-c36d35ec-e44a-4897-afba-617ee36f844f" acquired by "delete_volume" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d124a2-fa3d-443e-9845-78110c2b830d]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:49 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:49 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f Jun 04 13:37:49 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:50 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f" returned: 0 in 0.761s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:50 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:50 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f Jun 04 13:37:50 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:51 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-c36d35ec-e44a-4897-afba-617ee36f844f" returned: 0 in 0.576s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-quobyte-c36d35ec-e44a-4897-afba-617ee36f844f" released by "delete_volume" :: held 1.405s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Created reservations ['cc219549-2fef-48d9-9542-12e656a82faa', '5cd75a2e-91f2-48d9-929c-fdbe5d2747ea', '983d6bae-294a-4f70-9b3c-b38320ef8d08', '77885511-902f-414e-a6a5-2aeb03399160'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:51 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:51 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:51 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.581s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:51 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Deleted volume successfully. Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-4a8595c4-fdf8-47aa-87e3-4c16851f8c90 tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-c36d35ec-e44a-4897-afba-617ee36f844f-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:51 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "cinder-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba-delete_volume" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "cinder-quobyte-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" by "delete_volume" {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 04 13:37:52 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-quobyte-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" acquired by "delete_volume" :: waited 0.016s {{(pid=86722) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 04 13:37:52 devstack cinder-volume[86722]: DEBUG oslo.privsep.daemon [-] privsep: reply[be431582-f83b-4a6d-84f1-527ec6b41a53]: (4, 'qcow2') {{(pid=87568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 04 13:37:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:52 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba Jun 04 13:37:52 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:52 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" returned: 0 in 0.669s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:52 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:52 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba Jun 04 13:37:52 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:53 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c/volume-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" returned: 0 in 0.568s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:53 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-quobyte-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba" released by "delete_volume" :: held 1.282s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:37:53 devstack cinder-volume[86722]: DEBUG cinder.quota [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Created reservations ['c9795d81-d906-47bd-bcae-ae72a969a46b', '20212b22-ba31-474d-80be-812ac768b474', 'e6ef09c0-bcb5-4e75-b57e-d6ee6c5c4c78', 'eeef531a-3a23-4893-bea6-b9c196c8747f'] {{(pid=86722) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 04 13:37:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:37:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:37:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:37:53 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:37:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:37:53 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:37:53 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:37:53 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:37:54 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jun 04 13:37:54 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.569s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:37:54 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:37:54 devstack cinder-volume[86722]: INFO cinder.volume.manager [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Deleted volume successfully. Jun 04 13:37:54 devstack cinder-volume[86722]: DEBUG cinder.coordination [None req-0cbfa07c-826b-45a8-bf67-d5fa2c7a4a7a tempest-SnapshotDependencyTests-2119082495 None] Lock "cinder-54def48e-30fe-4ed5-ba7e-306f2ca6d8ba-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=86722) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 04 13:38:03 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=110,cinder:DELETE=12,cinder:SELECT=74,cinder:INSERT=29 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG dbcounter [-] [86722] Writing DB stats cinder:UPDATE=123,cinder:DELETE=7,cinder:SELECT=85,cinder:INSERT=30 {{(pid=86722) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076': None} {{(pid=86722) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG cinder.volume.drivers.quobyte [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-9d69576d-2768-453e-a90d-ed4473ad2076'] {{(pid=86722) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.lockutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86722) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 04 13:38:04 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c Jun 04 13:38:04 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 04 13:38:04 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG oslo_concurrency.processutils [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b9f8d0f17247ed40d92979a21f58067c" returned: 0 in 0.583s {{(pid=86722) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG cinder.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Notifying Schedulers of capabilities ... {{(pid=86722) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG oslo_service.periodic_task [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] Running periodic task VolumeManager._thread_info {{(pid=86722) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread count: 28 {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 04 13:38:04 devstack cinder-volume[86722]: DEBUG cinder.volume.manager [None req-050bbdd0-30fe-454f-affb-e1813592d3b7 None None] thread info: [<_MainThread(MainThread, started 128065106477184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86722) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}}